-- Logs begin at Mon 2022-08-22 19:28:21 UTC, end at Mon 2022-08-22 21:06:21 UTC. -- Aug 22 20:37:49.075456 dv-osbrick-853789-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 20:37:49.083168 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 20:37:49 2022] *** Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: nodename: dv-osbrick-853789-1-ceph Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: machine: x86_64 Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: clock source: unix Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: pcre jit disabled Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: detected number of CPU cores: 4 Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: current working directory: / Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: detected binary path: /usr/bin/uwsgi-core Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: your processes number limit is 47680 Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: your memory page size is 4096 bytes Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: detected max file descriptor number: 2048 Aug 22 20:37:49.086277 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: lock engine: pthread robust mutexes Aug 22 20:37:49.087019 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: thunder lock: enabled Aug 22 20:37:49.087019 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 20:37:49.087019 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 20:37:49.130895 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: Python main interpreter initialized at 0x55d2634319c0 Aug 22 20:37:49.130895 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: python threads support enabled Aug 22 20:37:49.130895 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: your server socket listen backlog is limited to 100 connections Aug 22 20:37:49.130895 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: your mercy for graceful operations on workers is 90 seconds Aug 22 20:37:49.131311 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 20:37:49.131311 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: *** Operational MODE: preforking *** Aug 22 20:37:49.131573 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: *** uWSGI is running in multiple interpreter mode *** Aug 22 20:37:49.131573 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: spawned uWSGI master process (pid: 100146) Aug 22 20:37:49.131769 dv-osbrick-853789-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 22 20:37:49.133825 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: spawned uWSGI worker 1 (pid: 100160, cores: 1) Aug 22 20:37:49.133825 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: spawned uWSGI worker 2 (pid: 100161, cores: 1) Aug 22 20:37:49.133825 dv-osbrick-853789-1-ceph devstack@keystone.service[100146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 20:37:53.732283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:37:53.732283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: from cryptography.utils import int_from_bytes Aug 22 20:37:53.733285 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:37:53.733285 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: from cryptography.utils import int_from_bytes Aug 22 20:37:53.735541 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:37:53.735541 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: from cryptography.utils import int_from_bytes Aug 22 20:37:53.736051 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:37:53.736051 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: from cryptography.utils import int_from_bytes Aug 22 20:37:53.782011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 20:37:53.782223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 20:37:53.782310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] command line args: [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 20:37:53.782606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 20:37:53.782770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ================================================================================ {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 20:37:53.783018 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] admin_token = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.783137 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 20:37:53.783229 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 20:37:53.783309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] config_dir = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.783371 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] command line args: [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 20:37:53.783434 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.783593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] config_source = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.783673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 20:37:53.783743 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] debug = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.783807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ================================================================================ {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 20:37:53.783893 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] admin_token = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] config_dir = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784469 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] insecure_debug = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] config_source = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784723 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784786 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] debug = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.784951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] list_limit = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785324 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785422 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] log_config_append = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785526 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] insecure_debug = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785619 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] log_dir = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.785910 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] log_file = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786008 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786112 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] list_limit = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] log_config_append = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786503 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786588 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] log_dir = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786715 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] log_file = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.786925 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787033 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787244 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787332 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787834 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.787956 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788190 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788311 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788401 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788474 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.788871 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789013 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] notification_format = cadf {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789130 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789228 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789303 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789568 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] publish_errors = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.789854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] notification_format = cadf {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790408 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] publish_errors = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790847 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.790955 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] standard_threads = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791190 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791307 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] strict_password_check = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791743 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] use_eventlog = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.791864 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792023 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] use_journal = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] standard_threads = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792236 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] use_json = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792236 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] use_stderr = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] strict_password_check = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] use_syslog = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] use_eventlog = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.792787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] use_journal = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.793081 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] watch_log_file = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.793261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] use_json = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.793403 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.793527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] use_stderr = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.793527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] use_syslog = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.793738 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.793833 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] watch_log_file = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:37:53.793925 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794124 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794610 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794704 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.794912 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795349 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795565 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795780 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.795896 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796344 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796454 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.796910 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797017 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797140 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797339 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797553 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797667 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797875 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.797996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798106 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798221 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798553 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798668 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798778 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.798999 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799449 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799866 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.799984 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800100 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800293 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800521 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800738 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800855 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.800964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801353 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801463 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801572 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801791 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.801907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802015 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802853 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.802960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803068 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803733 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.803971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804189 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804403 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804511 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804738 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.804953 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805356 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.805906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806171 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806290 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806617 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806738 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806848 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.806957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807451 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807579 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807690 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.807917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808028 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808145 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808255 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808610 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808721 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808831 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.808939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809198 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809308 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809649 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809878 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.809995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.810112 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.810222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.810339 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.810456 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.enabled = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.810566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.810775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.810895 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811007 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.enabled = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811236 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811349 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811573 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811683 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.811801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812270 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812380 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812781 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812874 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.812966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813214 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813313 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813405 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813480 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813550 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813660 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.813956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814284 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814747 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.814983 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815300 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815534 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815645 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815986 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.815986 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816311 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816420 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816744 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.816970 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817080 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817452 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] auth.external = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] auth.external = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817679 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] auth.mapped = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] auth.mapped = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.817898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818037 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818275 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818393 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] auth.password = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818504 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] auth.password = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] auth.token = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818723 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] auth.token = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818832 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.818941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] catalog.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] catalog.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819295 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819406 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819742 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.819969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820087 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820197 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] credential.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820536 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] credential.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820645 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] credential.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] credential.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820863 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.820972 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821244 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821482 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821701 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.821938 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822159 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822268 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822481 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822578 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822782 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.822892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823001 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823119 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823230 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823449 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823559 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823660 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823887 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.823997 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824324 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824663 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.824969 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825231 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825343 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825575 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825809 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.825919 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826138 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826248 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826565 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826680 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826790 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.826968 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827725 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.827954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828064 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828618 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.828946 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829424 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829533 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829643 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.829981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830096 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830316 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830544 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830751 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.830877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831234 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831536 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831536 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831737 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831862 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.831984 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832095 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832627 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832739 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832849 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.832959 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833195 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833628 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833839 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.833957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834068 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834177 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834286 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834737 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.834958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.password = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.password = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835298 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835410 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835740 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835850 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.835969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836412 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836751 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.836971 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837081 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837462 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837573 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837793 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.837911 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838030 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838141 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838252 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838374 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838828 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.838939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839361 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839480 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.839798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840013 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840568 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840797 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.840906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841015 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841180 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.841967 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842085 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842195 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842305 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842636 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842866 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.842975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843084 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843193 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843420 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843538 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843649 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.843962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844079 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844456 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] policy.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] policy.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.844905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845015 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845152 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845264 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] receipt.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] receipt.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.845981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846099 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846197 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846305 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846679 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846796 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.846908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847018 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847163 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847163 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847713 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847822 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.847930 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848040 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848268 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] revoke.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848378 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] revoke.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848488 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848597 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848707 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.848889 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] role.cache_time = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] role.cache_time = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] role.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] role.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] role.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] role.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] role.list_limit = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] role.list_limit = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.849967 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850304 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850638 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850748 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.850978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851090 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851314 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851535 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851764 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851876 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.851986 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852095 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852435 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852779 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.852891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.853010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.853227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.853400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.853569 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.853692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.853818 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.853931 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854137 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854475 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854587 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.854918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855259 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855479 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.855861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.856042 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.856222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.856402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.856586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.856741 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.856865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.856977 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857251 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857348 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857579 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.cache_time = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.cache_time = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857801 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.857910 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858252 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.provider = fernet {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.provider = fernet {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858472 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.858919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859030 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859140 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859358 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859806 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] trust.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.859915 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] trust.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860024 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860133 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860364 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860693 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.860920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861618 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861730 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861840 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.connection = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.861959 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.connection = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862104 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862677 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862787 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.862897 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863116 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863455 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863785 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.863904 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864015 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864336 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864788 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.864898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865371 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865482 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865701 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865811 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.865932 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.866044 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:37:53.866154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 20:37:53.866264 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 20:37:53.894950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.895171 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.895396 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.895567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.895769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.895990 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.903829 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.904198 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.933347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.933629 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.933860 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.934062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.984959 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:53.985298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.033728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.033939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.034088 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.034253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.100455 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.100733 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.100824 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.100955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101165 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101317 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101442 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.101943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.124473 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.124716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.124813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.124994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125228 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125310 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125374 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125588 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125783 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.125928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.126143 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.137617 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.137764 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.150555 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.150793 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.150986 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151276 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151355 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151474 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151788 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.151996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.152203 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:37:54.168539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.168727 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:37:54.169082 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.169248 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.169386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:37:54.169494 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:37:54.169572 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.169782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.169907 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.170043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:37:54.170125 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.170202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.170277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.170474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.170707 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.170978 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.179765 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.180040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.180308 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.180432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.180566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.180646 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.180882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.181198 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.187503 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.188032 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.190419 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.190695 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.190983 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.191132 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.191266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.191388 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.191569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.191682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.191798 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.191913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192160 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192278 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192790 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.192920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.193032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.193178 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.193422 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.193678 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.217276 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.217987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.218731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.219011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.219368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.219659 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.223618 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.223951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.224180 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.224361 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.224643 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.224939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.230702 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.230989 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.231328 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.231607 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.236346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.236346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.236346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.236689 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.236791 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.236902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237002 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237509 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237904 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237904 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.237904 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.252732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.253423 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.253549 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.253769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.257063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.257575 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.260511 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.260802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.261010 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.261324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.265128 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.265605 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.268316 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.268908 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.271638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.271897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.272139 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.272221 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.272296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.272452 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.272590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.272705 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.272793 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.273005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.273165 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.273403 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.288755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.289041 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.289168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.289329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.289460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.289572 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.289664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.289889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.296235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.296482 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.297926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.298162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.298315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.298531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.300839 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.301086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.301241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.301372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.301492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.301694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.301818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.302046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.302172 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.302306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.313145 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.313455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.313598 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.313743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.313825 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.313997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.314139 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.314275 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.314355 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.314516 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.314606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.314812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.314936 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.315061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.330092 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.330256 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.332980 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.333130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.335970 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.336116 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.337428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.337554 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.338960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.339086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.339220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.339299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.339507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.339644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.345900 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.346020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.347376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.347543 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.350202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.350410 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.350626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.350770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.350895 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.351050 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.351224 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.351346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.360435 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.360666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.360761 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.360970 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.361063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.361275 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.367757 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=100160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.367989 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=100161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:37:54.368114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.368369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.368494 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.368655 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.368822 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.368919 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.369045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.369188 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.369276 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.369488 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.369611 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.369745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.369836 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370039 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370751 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370835 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.370899 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.371073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.371198 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.371332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=100160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.371448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.371568 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=100161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:37:54.404549 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d2634319c0 pid: 100161 (default app) Aug 22 20:37:54.404688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d2634319c0 pid: 100160 (default app) Aug 22 20:37:54.408091 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab5cb-173f-4c74-b59f-5592ec3b5dec None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:54.408377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab5cb-173f-4c74-b59f-5592ec3b5dec None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:54.408648 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab5cb-173f-4c74-b59f-5592ec3b5dec None None] PATH_INFO: `/v3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:54.413054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Mon Aug 22 20:37:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:01.671367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307c79-7b03-4273-a93f-9d1e7ebf6455 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:01.672058 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307c79-7b03-4273-a93f-9d1e7ebf6455 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:01.672058 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307c79-7b03-4273-a93f-9d1e7ebf6455 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:01.677187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:01.683499 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:01.684004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:01.684074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:01.767635 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: INFO dbcounter [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] Registered counter for database keystone Aug 22 20:38:01.789433 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG oslo_db.sqlalchemy.engines [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 20:38:01.798879 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writer thread running {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 20:38:02.008226 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG passlib.handlers.bcrypt [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=100161) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 20:38:02.008543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG passlib.handlers.bcrypt [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=100161) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 20:38:02.064931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:02.066599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:02.202326 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 20:38:02.707123 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1307c79-7b03-4273-a93f-9d1e7ebf6455 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:02.787982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: INFO dbcounter [None req-f1307c79-7b03-4273-a93f-9d1e7ebf6455 None None] Registered counter for database keystone Aug 22 20:38:02.813450 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG oslo_db.sqlalchemy.engines [None req-f1307c79-7b03-4273-a93f-9d1e7ebf6455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 20:38:02.821539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writer thread running {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 20:38:02.940328 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1307c79-7b03-4273-a93f-9d1e7ebf6455 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:02.945975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fc8e5-c9b9-4b1a-923b-fb28b074407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:02.946647 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc8e5-c9b9-4b1a-923b-fb28b074407e admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:02.946922 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc8e5-c9b9-4b1a-923b-fb28b074407e admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:02.947194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc8e5-c9b9-4b1a-923b-fb28b074407e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:02.956571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fc8e5-c9b9-4b1a-923b-fb28b074407e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:03.007949 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ac1fc8e5-c9b9-4b1a-923b-fb28b074407e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 20:38:03.008226 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fc8e5-c9b9-4b1a-923b-fb28b074407e admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:03.019487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Aug 22 20:38:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 20:38:03.028759 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:03.046363 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203b892-18fb-4fa6-aee5-416fb6fdf091 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:03.051615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9ebfc-3ae6-4734-b694-dfdeefb89327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:03.052730 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ebfc-3ae6-4734-b694-dfdeefb89327 admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:03.053033 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ebfc-3ae6-4734-b694-dfdeefb89327 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:03.053343 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ebfc-3ae6-4734-b694-dfdeefb89327 admin admin] PATH_INFO: `/v3/projects/7cc9a30a2c0d456c80b6d663506d1794` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:03.054811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9ebfc-3ae6-4734-b694-dfdeefb89327 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cc9a30a2c0d456c80b6d663506d1794)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:03.105532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7aa9ebfc-3ae6-4734-b694-dfdeefb89327 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 20:38:03.105879 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9ebfc-3ae6-4734-b694-dfdeefb89327 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:03.110653 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Mon Aug 22 20:38:03 2022] GET /identity/v3/projects/7cc9a30a2c0d456c80b6d663506d1794 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:05.348426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed46c-38a3-487f-bb76-f5b3473e29ed None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.349025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed46c-38a3-487f-bb76-f5b3473e29ed None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.349025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed46c-38a3-487f-bb76-f5b3473e29ed None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.353246 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:05.360128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909db2b-9221-4093-84d9-7120cf684af9 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.360883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909db2b-9221-4093-84d9-7120cf684af9 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.361012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909db2b-9221-4093-84d9-7120cf684af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.384661 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-0909db2b-9221-4093-84d9-7120cf684af9 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:05.386270 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-0909db2b-9221-4093-84d9-7120cf684af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:05.396489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 20:38:05.725863 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed46c-38a3-487f-bb76-f5b3473e29ed None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:05.740576 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed46c-38a3-487f-bb76-f5b3473e29ed None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:05.746020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59ed9-3da6-48e1-940d-fdbd28adc238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:05.746616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59ed9-3da6-48e1-940d-fdbd28adc238 admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.746892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59ed9-3da6-48e1-940d-fdbd28adc238 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.747156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59ed9-3da6-48e1-940d-fdbd28adc238 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.755604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe59ed9-3da6-48e1-940d-fdbd28adc238 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:05.757377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe59ed9-3da6-48e1-940d-fdbd28adc238 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:05.766559 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Aug 22 20:38:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:38:05.773320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909db2b-9221-4093-84d9-7120cf684af9 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:05.787353 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909db2b-9221-4093-84d9-7120cf684af9 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:05.793625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998c7a8-5cf1-434e-a55f-e88827b4c3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:05.794262 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c7a8-5cf1-434e-a55f-e88827b4c3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.794538 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c7a8-5cf1-434e-a55f-e88827b4c3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.794805 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c7a8-5cf1-434e-a55f-e88827b4c3a5 admin admin] PATH_INFO: `/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.796327 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998c7a8-5cf1-434e-a55f-e88827b4c3a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cce5922f39ab43c1aa73a41f5fc3c2f3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:05.798224 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998c7a8-5cf1-434e-a55f-e88827b4c3a5 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:05.800350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Mon Aug 22 20:38:05 2022] GET /identity/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:08.058764 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04a26-dd55-4254-a903-d390c6bf2e58 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.059455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04a26-dd55-4254-a903-d390c6bf2e58 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.059455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04a26-dd55-4254-a903-d390c6bf2e58 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.060583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:08.066716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b28188-1af3-4fd8-a078-434f9120cd02 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.067196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b28188-1af3-4fd8-a078-434f9120cd02 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.067376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b28188-1af3-4fd8-a078-434f9120cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.074018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da56a3-2b11-47b7-98c7-797f910eb2ab None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.074394 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da56a3-2b11-47b7-98c7-797f910eb2ab None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.074789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da56a3-2b11-47b7-98c7-797f910eb2ab None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.076663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:08.082688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.083094 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.083429 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.092849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-06b28188-1af3-4fd8-a078-434f9120cd02 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:08.094777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-06b28188-1af3-4fd8-a078-434f9120cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:08.130335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG passlib.handlers.bcrypt [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=100160) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 20:38:08.130892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG passlib.handlers.bcrypt [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=100160) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 20:38:08.176986 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:08.178673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:08.299297 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:08.304985 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:08.622862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b28188-1af3-4fd8-a078-434f9120cd02 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:08.624744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:08.665970 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:08.741808 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:08.744846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414eaf8-c2d2-4b5f-a58b-df6f1225858f None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:08.753355 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b28188-1af3-4fd8-a078-434f9120cd02 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:08.785020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:08.785920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.786199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.786468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.788234 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:08.788879 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.789186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.789489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.801428 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:08.810063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:08.811147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:08.811964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:08.817496 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:08.856870 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:08.858517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:08.900161 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:08.920661 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81809f38-93fc-44c2-b05d-73f66f1c9a56 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:08.953032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:08.954238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:08.954944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.955674 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.955954 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.956666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:08.956972 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:08.957155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 8/15] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:08.958404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:08.963109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:08.970936 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 8/16] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:08.976620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:09.064415 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a33da-967d-40d2-b886-b584115f9570 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:09.080523 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9d11-8298-4e7f-8ed8-ba75f22ce9f6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:09.099088 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:09.100066 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:09.100335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:09.100599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:09.116684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:09.117379 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:09.117650 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:09.117918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] PATH_INFO: `/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:09.119219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cce5922f39ab43c1aa73a41f5fc3c2f3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:09.120698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:09.121072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:09.122320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:08 2022] GET /identity/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:09.122586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:09.128330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:09.143681 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:09.242168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d18b3-7310-423c-abe0-e3a6427518d6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:38:09.252763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:09.253744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:38:09.254561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:38:09.254561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:38:09.254561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:09.254561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 9/18] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:09.260411 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:09.280327 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:09.280955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:09.281272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:09.281524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:09.282655 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:09.284246 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:09.285829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 10/19] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:09.291746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:09.313858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:09.360926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9bac9-a18d-4bd9-b993-8f9da55860d8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:09.372194 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:09.392302 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49cc62-8f6c-4001-8e03-ff2e6738b266 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:09.395289 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b4dad-d445-47be-9a8e-bc270179e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:09.395893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b4dad-d445-47be-9a8e-bc270179e293 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:09.396182 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b4dad-d445-47be-9a8e-bc270179e293 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:09.396428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b4dad-d445-47be-9a8e-bc270179e293 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:09.397062 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b4dad-d445-47be-9a8e-bc270179e293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:09.397387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b4dad-d445-47be-9a8e-bc270179e293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:09.398757 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b4dad-d445-47be-9a8e-bc270179e293 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:09.416332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 10/20] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:09.427715 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810872d-e036-43f5-a600-adee86866a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:09.428369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810872d-e036-43f5-a600-adee86866a2b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:09.428648 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810872d-e036-43f5-a600-adee86866a2b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:09.428919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810872d-e036-43f5-a600-adee86866a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:09.429767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810872d-e036-43f5-a600-adee86866a2b None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.domain.id=default, user.id=cce5922f39ab43c1aa73a41f5fc3c2f3) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:09.430016 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810872d-e036-43f5-a600-adee86866a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:09.431506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810872d-e036-43f5-a600-adee86866a2b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:09.440005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 11/21] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Aug 22 20:38:09 2022] GET /identity/v3/role_assignments?user.id=cce5922f39ab43c1aa73a41f5fc3c2f3&scope.domain.id=default&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:11.808861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975cbb2-9d28-472c-87c6-e26ba18c80d5 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:11.809674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975cbb2-9d28-472c-87c6-e26ba18c80d5 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:11.809674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975cbb2-9d28-472c-87c6-e26ba18c80d5 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:11.810911 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 11/22] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:11.817752 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62328-8c7b-4cca-bd29-c1a9e9d290cc None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:11.818254 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62328-8c7b-4cca-bd29-c1a9e9d290cc None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:11.818325 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62328-8c7b-4cca-bd29-c1a9e9d290cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:11.842613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9fb62328-8c7b-4cca-bd29-c1a9e9d290cc None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:11.843887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9fb62328-8c7b-4cca-bd29-c1a9e9d290cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:11.950134 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 12/23] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:12.341714 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80d33b-75d2-4c78-9267-7a1223743ed7 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.341991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80d33b-75d2-4c78-9267-7a1223743ed7 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.342456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80d33b-75d2-4c78-9267-7a1223743ed7 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:12.344215 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:12.349356 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e9dc-d82c-44ca-934a-a634bc558d03 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.349826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e9dc-d82c-44ca-934a-a634bc558d03 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.350233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e9dc-d82c-44ca-934a-a634bc558d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:12.373984 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d0d4e9dc-d82c-44ca-934a-a634bc558d03 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:12.375555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d0d4e9dc-d82c-44ca-934a-a634bc558d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:12.473054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 13/25] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:12.547772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80d33b-75d2-4c78-9267-7a1223743ed7 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:12.697797 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80d33b-75d2-4c78-9267-7a1223743ed7 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:12.715388 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:12.747040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd65c2-915d-4ce7-b2b6-7f4bac9296f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:12.747690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd65c2-915d-4ce7-b2b6-7f4bac9296f8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.747968 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd65c2-915d-4ce7-b2b6-7f4bac9296f8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.748238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd65c2-915d-4ce7-b2b6-7f4bac9296f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:12.761704 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326b5a-1c89-4a33-bb64-d2468adbe25c None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.761999 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326b5a-1c89-4a33-bb64-d2468adbe25c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.762258 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326b5a-1c89-4a33-bb64-d2468adbe25c None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:12.763588 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 14/26] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:12.770094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3ea28-e717-4702-ae84-bcb85bb8d38b None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.770377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3ea28-e717-4702-ae84-bcb85bb8d38b None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.770812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3ea28-e717-4702-ae84-bcb85bb8d38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:12.777120 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd65c2-915d-4ce7-b2b6-7f4bac9296f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-65fd65c2-915d-4ce7-b2b6-7f4bac9296f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:12.781825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:12.782916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 13/27] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:12.788227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197afa47-ad4a-4ced-b484-38b023ad7235 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.789220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197afa47-ad4a-4ced-b484-38b023ad7235 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.789220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197afa47-ad4a-4ced-b484-38b023ad7235 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:12.791580 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 14/28] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:12.792230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:12.793686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197afa47-ad4a-4ced-b484-38b023ad7235 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:12.806029 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-c7f3ea28-e717-4702-ae84-bcb85bb8d38b None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:12.813839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-c7f3ea28-e717-4702-ae84-bcb85bb8d38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:12.929082 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197afa47-ad4a-4ced-b484-38b023ad7235 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:12.991997 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 15/29] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:12.994001 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f63bf-cea6-4114-88c7-6df6cbff456b None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.995256 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f63bf-cea6-4114-88c7-6df6cbff456b None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.995715 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f63bf-cea6-4114-88c7-6df6cbff456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.019383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-b53f63bf-cea6-4114-88c7-6df6cbff456b None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:13.021227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-b53f63bf-cea6-4114-88c7-6df6cbff456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:13.029910 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:13.030548 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:13.030824 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:13.031327 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.032165 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:13.032611 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:13.034263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:13.066689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 15/30] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:13.069000 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:13.149458 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:13.162076 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 16/31] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:13.163049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f63bf-cea6-4114-88c7-6df6cbff456b None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:13.285338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:13.286659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565a02-f0bb-4192-8bcb-9acb51f3b9a4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:13.354162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f63bf-cea6-4114-88c7-6df6cbff456b None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:13.366907 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:13.367544 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:13.367815 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:13.368077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.368751 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:13.370185 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:13.433505 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:13.434173 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:13.434485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:13.434785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] PATH_INFO: `/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.439060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] RBAC: Authorizing `identity:get_user(user_id=cce5922f39ab43c1aa73a41f5fc3c2f3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:13.440249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:13.442623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 17/32] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:13 2022] GET /identity/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:13.449634 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:13.550798 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 16/33] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 22 20:38:13 2022] POST /identity/v3/roles => generated 225 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:13.551501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:13.622167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2373c7-25d3-45db-90f1-05975670a266 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:13.666166 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:13.684385 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:13.685371 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:13.685781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:13.686198 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.688890 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:13.690961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:13.700397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 18/34] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:13.708500 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:13.765499 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:13.784118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52811-6041-417c-9065-e462d5f8fcd9 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:13.841391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71037c0-8a33-4f18-af38-81851a4b2e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:13.842086 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71037c0-8a33-4f18-af38-81851a4b2e2e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:13.842421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71037c0-8a33-4f18-af38-81851a4b2e2e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:13.842638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71037c0-8a33-4f18-af38-81851a4b2e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.855722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71037c0-8a33-4f18-af38-81851a4b2e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:13.857443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71037c0-8a33-4f18-af38-81851a4b2e2e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-f71037c0-8a33-4f18-af38-81851a4b2e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:38:13.877803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:13.878735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:38:13.879546 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:38:13.879546 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:38:13.879546 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:13.881149 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 17/35] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:13.883258 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e3da5-94de-4c6d-8002-3c4500404b23 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:13.890386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e3da5-94de-4c6d-8002-3c4500404b23 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:13.890386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e3da5-94de-4c6d-8002-3c4500404b23 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.890386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 18/36] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:13.890386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e3da5-94de-4c6d-8002-3c4500404b23 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:13.936282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6d5c-5eee-46d6-af0d-3929dcdf7afb None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:13.985129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb269e7b-b4a7-4308-bc2c-b6b06300f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:13.985854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb269e7b-b4a7-4308-bc2c-b6b06300f32e None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:13.986182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb269e7b-b4a7-4308-bc2c-b6b06300f32e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:13.986534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb269e7b-b4a7-4308-bc2c-b6b06300f32e None admin] PATH_INFO: `/v3/domains/default/users/cce5922f39ab43c1aa73a41f5fc3c2f3/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:13.988593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb269e7b-b4a7-4308-bc2c-b6b06300f32e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cce5922f39ab43c1aa73a41f5fc3c2f3, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:13.990733 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb269e7b-b4a7-4308-bc2c-b6b06300f32e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:14.044768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e3da5-94de-4c6d-8002-3c4500404b23 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:14.095384 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:14.096577 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.097002 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.097555 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.098427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:14.100187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:14.125808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 19/37] 10.222.0.50 () {58 vars in 1361 bytes} [Mon Aug 22 20:38:13 2022] PUT /identity/v3/domains/default/users/cce5922f39ab43c1aa73a41f5fc3c2f3/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:38:14.129767 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 19/38] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 22 20:38:13 2022] POST /identity/v3/roles => generated 219 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:14.130920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:14.135837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0fca5-2ec9-4d65-a4ba-ffb1d0753a60 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.136553 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0fca5-2ec9-4d65-a4ba-ffb1d0753a60 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.137218 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0fca5-2ec9-4d65-a4ba-ffb1d0753a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.167094 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:14.189135 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-2fc0fca5-2ec9-4d65-a4ba-ffb1d0753a60 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:14.193132 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-2fc0fca5-2ec9-4d65-a4ba-ffb1d0753a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:14.342792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:14.362688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 20/39] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:14.364524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2438f8-5820-4370-b8d3-70319a1ad541 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.366107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2438f8-5820-4370-b8d3-70319a1ad541 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.366622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2438f8-5820-4370-b8d3-70319a1ad541 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.371534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 21/40] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:14.379607 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff427b7-a75a-43c7-883f-1582bfec24fa None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.379950 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff427b7-a75a-43c7-883f-1582bfec24fa None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.380307 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff427b7-a75a-43c7-883f-1582bfec24fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.389407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d27de-79ae-45e7-867e-d61125f29347 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:14.426523 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-2ff427b7-a75a-43c7-883f-1582bfec24fa None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:14.427870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-2ff427b7-a75a-43c7-883f-1582bfec24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:14.465204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:14.466064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.466409 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.466682 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.467723 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:14.468091 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:14.469862 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:14.494060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 20/41] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:14.502446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:14.536590 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 22/42] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:14.599665 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:14.647164 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862836-a98e-4fdc-a76e-9895cefcd79b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:14.688944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:14.690330 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.690820 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.691382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.692533 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:14.694267 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:14.729658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 21/43] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:38:14 2022] POST /identity/v3/projects => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:14.785066 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff427b7-a75a-43c7-883f-1582bfec24fa None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:14.911692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff427b7-a75a-43c7-883f-1582bfec24fa None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:14.937720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:14.950673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:14.951297 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.951578 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.951852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.952539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:14.954154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:14.973351 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 22 20:38:14 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:15.174509 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:15.303540 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf3c5-d996-4edc-b74c-35897c3c6eac None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:15.322175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:15.342563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170774c0-849a-4454-b147-b7add2e06c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:15.343217 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170774c0-849a-4454-b147-b7add2e06c7d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:15.343497 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170774c0-849a-4454-b147-b7add2e06c7d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:15.343767 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170774c0-849a-4454-b147-b7add2e06c7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:15.344933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170774c0-849a-4454-b147-b7add2e06c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:15.347937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170774c0-849a-4454-b147-b7add2e06c7d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:15.349656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 22/45] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:15.355439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:15.484728 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a4bbc-3e5e-4d39-8f94-c95a02125cb5 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:15.530073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8477b0b-c2ff-416b-8fb7-7131fee9ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:15.530798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8477b0b-c2ff-416b-8fb7-7131fee9ead0 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:15.531082 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8477b0b-c2ff-416b-8fb7-7131fee9ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:15.531434 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8477b0b-c2ff-416b-8fb7-7131fee9ead0 None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:15.532270 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8477b0b-c2ff-416b-8fb7-7131fee9ead0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:15.534285 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8477b0b-c2ff-416b-8fb7-7131fee9ead0 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:15.585136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:38:15 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:16.571695 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8b934-5cd7-49da-990a-685f35892564 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:16.572291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8b934-5cd7-49da-990a-685f35892564 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:16.572406 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8b934-5cd7-49da-990a-685f35892564 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:16.574477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 23/47] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:16.581381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2ec7-417b-49cd-bccf-9f7b2df14ac8 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:16.581887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2ec7-417b-49cd-bccf-9f7b2df14ac8 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:16.581958 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2ec7-417b-49cd-bccf-9f7b2df14ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:16.603077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-f9ab2ec7-417b-49cd-bccf-9f7b2df14ac8 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:16.604317 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-f9ab2ec7-417b-49cd-bccf-9f7b2df14ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:16.636242 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:16.702078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 25/48] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:17.110211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8b934-5cd7-49da-990a-685f35892564 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:17.230423 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8b934-5cd7-49da-990a-685f35892564 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:17.271811 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:17.272473 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:17.272732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:17.272996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:17.285579 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:17.290369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:17.291238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:17.292083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 24/49] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:17.298088 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab2ec7-417b-49cd-bccf-9f7b2df14ac8 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:17.405616 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab2ec7-417b-49cd-bccf-9f7b2df14ac8 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:17.444077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:17.445127 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:17.445677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:17.446149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:17.447418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] RBAC: Adding query filter params (name=admin) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:17.448316 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:17.451026 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:17.462552 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 26/50] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:17.468553 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:17.521930 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:17.588245 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dde6a2-ce00-449d-adfd-d108f6fb4c61 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:17.625943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:17.626596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:17.626965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:17.627251 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] PATH_INFO: `/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:17.628677 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] RBAC: Authorizing `identity:get_user(user_id=cce5922f39ab43c1aa73a41f5fc3c2f3)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:17.630186 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:17.631819 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 25/51] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:17 2022] GET /identity/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:17.639402 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:17.680254 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:17.765452 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480f48-8ce3-4dea-9c48-5611e766968d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:17.805734 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb61dfd-d796-4002-99a9-1f1e43565ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:17.806819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb61dfd-d796-4002-99a9-1f1e43565ad3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:17.807111 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb61dfd-d796-4002-99a9-1f1e43565ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:17.807387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb61dfd-d796-4002-99a9-1f1e43565ad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:17.808701 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb61dfd-d796-4002-99a9-1f1e43565ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:17.810252 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb61dfd-d796-4002-99a9-1f1e43565ad3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:17.811979 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 27/52] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:17.818994 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:17.930505 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e820f5-2a8a-44b4-908d-c8bdc94ae8dc None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:17.947029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:17.970020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:17.970650 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:17.970929 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:17.971204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:17.972009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.domain.id=default, user.id=cce5922f39ab43c1aa73a41f5fc3c2f3) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:17.972306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:17.973802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:17.977534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae064b3-f022-4323-8dca-736fbc3b7fff None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:17.977820 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae064b3-f022-4323-8dca-736fbc3b7fff None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:17.978098 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae064b3-f022-4323-8dca-736fbc3b7fff None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:17.979464 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 28/53] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:17.984284 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 26/54] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Aug 22 20:38:17 2022] GET /identity/v3/role_assignments?user.id=cce5922f39ab43c1aa73a41f5fc3c2f3&scope.domain.id=default&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:17.984728 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc852c-2065-430b-acc8-2f5ffdf873f4 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:17.985015 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc852c-2065-430b-acc8-2f5ffdf873f4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:17.985329 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc852c-2065-430b-acc8-2f5ffdf873f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:18.005211 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-5fcc852c-2065-430b-acc8-2f5ffdf873f4 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:18.006463 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-5fcc852c-2065-430b-acc8-2f5ffdf873f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:18.087988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 29/55] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:18.415408 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:18.530857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c75dfe-1948-42fe-b121-2446a7589b2f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:18.568247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67bbfa-1f20-457f-b36b-7114021db889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:18.568916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67bbfa-1f20-457f-b36b-7114021db889 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:18.569228 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67bbfa-1f20-457f-b36b-7114021db889 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:18.569498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67bbfa-1f20-457f-b36b-7114021db889 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:18.570633 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67bbfa-1f20-457f-b36b-7114021db889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:18.572161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67bbfa-1f20-457f-b36b-7114021db889 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:18.573790 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 27/56] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:18.580543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc852c-2065-430b-acc8-2f5ffdf873f4 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:18.606819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:18.691637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc852c-2065-430b-acc8-2f5ffdf873f4 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:18.727051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8cf63-e61e-4515-a716-02ecd8dcb2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:18.727664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cf63-e61e-4515-a716-02ecd8dcb2ac None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:18.727938 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cf63-e61e-4515-a716-02ecd8dcb2ac None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:18.728203 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cf63-e61e-4515-a716-02ecd8dcb2ac None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:18.728857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8cf63-e61e-4515-a716-02ecd8dcb2ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:18.730360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8cf63-e61e-4515-a716-02ecd8dcb2ac None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:18.758404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 30/57] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Aug 22 20:38:18 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:20.991697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcafed2-e1de-403f-bfff-0986ba9d9664 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:20.992567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcafed2-e1de-403f-bfff-0986ba9d9664 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:20.992567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcafed2-e1de-403f-bfff-0986ba9d9664 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:20.994680 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 28/58] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:21.000123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d9aa-7da0-4291-b6b6-69d42efdcd9a None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:21.000540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d9aa-7da0-4291-b6b6-69d42efdcd9a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:21.000661 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d9aa-7da0-4291-b6b6-69d42efdcd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:21.020963 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-31a7d9aa-7da0-4291-b6b6-69d42efdcd9a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:21.022196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-31a7d9aa-7da0-4291-b6b6-69d42efdcd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:21.093362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 31/59] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:21.415404 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcafed2-e1de-403f-bfff-0986ba9d9664 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:21.466500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:21.525764 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcafed2-e1de-403f-bfff-0986ba9d9664 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:21.567939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9ef21-3d2a-48cd-89e6-431614664530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:21.568567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9ef21-3d2a-48cd-89e6-431614664530 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:21.568842 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9ef21-3d2a-48cd-89e6-431614664530 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:21.569140 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9ef21-3d2a-48cd-89e6-431614664530 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:21.570260 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9ef21-3d2a-48cd-89e6-431614664530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:21.571706 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9ef21-3d2a-48cd-89e6-431614664530 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:21.573328 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 29/60] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:21.579167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d9aa-7da0-4291-b6b6-69d42efdcd9a None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:21.583117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:21.699596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d9aa-7da0-4291-b6b6-69d42efdcd9a None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:21.739158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32864e3f-7336-4cf8-bbee-cf0d5278e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:21.739774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864e3f-7336-4cf8-bbee-cf0d5278e01b None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:21.740053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864e3f-7336-4cf8-bbee-cf0d5278e01b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:21.740322 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864e3f-7336-4cf8-bbee-cf0d5278e01b None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:21.740974 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32864e3f-7336-4cf8-bbee-cf0d5278e01b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:21.742512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32864e3f-7336-4cf8-bbee-cf0d5278e01b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:21.774578 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 32/61] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:38:21 2022] POST /identity/v3/users => generated 275 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:25.300978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6309-82b3-48ee-810f-4422a0a8b3ea None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.300978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6309-82b3-48ee-810f-4422a0a8b3ea None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.300978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6309-82b3-48ee-810f-4422a0a8b3ea None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.300978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 30/62] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:25.306802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160495-ee63-43f2-8db6-6672d5352af3 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.307278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160495-ee63-43f2-8db6-6672d5352af3 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.307352 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160495-ee63-43f2-8db6-6672d5352af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.337684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-1e160495-ee63-43f2-8db6-6672d5352af3 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:25.338936 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-1e160495-ee63-43f2-8db6-6672d5352af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:25.428539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:25.441616 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 33/63] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:25.604669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a4c8-be65-46e4-84d0-a0b155da4069 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.605383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a4c8-be65-46e4-84d0-a0b155da4069 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.605890 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a4c8-be65-46e4-84d0-a0b155da4069 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.607587 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 31/64] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:25.614947 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96a70a-4d5d-4396-a2df-7d94e8df41a7 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.615647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96a70a-4d5d-4396-a2df-7d94e8df41a7 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.616118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96a70a-4d5d-4396-a2df-7d94e8df41a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.649389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-bd96a70a-4d5d-4396-a2df-7d94e8df41a7 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:25.651099 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-bd96a70a-4d5d-4396-a2df-7d94e8df41a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:25.675237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1870d8-458f-4265-b317-74dc2f866648 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.676211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1870d8-458f-4265-b317-74dc2f866648 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.676930 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1870d8-458f-4265-b317-74dc2f866648 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.679428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 32/65] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:25.685945 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d23e5d-67a4-4f23-b7ae-ea8d368f5d93 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.686566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d23e5d-67a4-4f23-b7ae-ea8d368f5d93 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.687032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d23e5d-67a4-4f23-b7ae-ea8d368f5d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.711978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e1d23e5d-67a4-4f23-b7ae-ea8d368f5d93 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:25.714146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e1d23e5d-67a4-4f23-b7ae-ea8d368f5d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:25.803709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 34/66] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:25.806126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 33/67] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:25.913770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754996-f71c-4b8e-b61d-2850c9a1ae5e None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.914458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754996-f71c-4b8e-b61d-2850c9a1ae5e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.914920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754996-f71c-4b8e-b61d-2850c9a1ae5e None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.916561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 35/68] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:25.922460 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657690-0ae8-46e8-a798-d533ed678146 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:25.923070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657690-0ae8-46e8-a798-d533ed678146 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:25.924001 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657690-0ae8-46e8-a798-d533ed678146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:25.950787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-6a657690-0ae8-46e8-a798-d533ed678146 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:25.952460 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-6a657690-0ae8-46e8-a798-d533ed678146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:25.959422 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754996-f71c-4b8e-b61d-2850c9a1ae5e None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.041264 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:26.071148 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 34/69] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:26.116619 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754996-f71c-4b8e-b61d-2850c9a1ae5e None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.144325 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:26.159677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088a63c-6ee6-45e4-b28d-1436b69df879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.160319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a63c-6ee6-45e4-b28d-1436b69df879 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.160664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a63c-6ee6-45e4-b28d-1436b69df879 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.160947 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a63c-6ee6-45e4-b28d-1436b69df879 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.172894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088a63c-6ee6-45e4-b28d-1436b69df879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-8088a63c-6ee6-45e4-b28d-1436b69df879 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:26.177776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:26.178706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:26.179896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 36/70] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:38:26.184932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a657690-0ae8-46e8-a798-d533ed678146 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.191470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997301-e47b-4662-a46c-bdd3ed59b3ec None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.192030 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997301-e47b-4662-a46c-bdd3ed59b3ec None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.192503 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997301-e47b-4662-a46c-bdd3ed59b3ec None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.194112 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 37/71] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:26.199587 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef9dd1-30f9-4a99-95b8-e6fa9dae78a8 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.200165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef9dd1-30f9-4a99-95b8-e6fa9dae78a8 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.200635 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef9dd1-30f9-4a99-95b8-e6fa9dae78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.221199 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d1ef9dd1-30f9-4a99-95b8-e6fa9dae78a8 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:26.222819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d1ef9dd1-30f9-4a99-95b8-e6fa9dae78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:26.299635 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a657690-0ae8-46e8-a798-d533ed678146 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.325118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 38/72] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:26.325118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef9dd1-30f9-4a99-95b8-e6fa9dae78a8 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.347155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.347875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.348248 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.348536 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.349407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:26.349706 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:26.351395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:26.365855 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 35/73] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:26.367334 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.414225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:26.458262 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef9dd1-30f9-4a99-95b8-e6fa9dae78a8 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.472554 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:26.501627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.502458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.502785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.503040 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.516090 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:26.516813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074facd7-7859-4416-acb8-1dd63324fcab None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:26.522062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:26.522971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:26.523813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 39/74] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:26.528934 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.561823 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.562501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.562775 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.563030 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.582007 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:26.587254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:26.588126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 36/75] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:26.594083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.667199 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf283a18-d074-467a-900f-de973b29d4b6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.707599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:26.709916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.710494 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.710769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.711045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.716037 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f4d9-7069-41c2-9fb8-4bde85b277a8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.735752 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:26.738899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:26.742292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 40/76] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:26.743730 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.765452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.766501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.767037 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.767517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.779982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:26.781415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:26.785433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:26.789582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 37/77] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:26.790348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.884626 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808022e-e55a-422b-934b-d462323f14f9 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.902782 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089575-ed6f-45d5-ade2-b904c02dd1bc None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:26.922523 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.923173 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.923470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.923735 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.924492 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:26.924792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:26.926256 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:26.935455 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 41/78] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:26.937992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.944666 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:26.945322 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:26.945602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:26.945870 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:26.946536 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:26.946835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:26.948225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:26.957197 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 38/79] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:26.957945 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:26.978247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.052488 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.063392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0900aa-4fde-4be6-9f6a-4ae70a6ced21 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.070320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee14a-76e2-42b7-ae01-65ea61d65339 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.100693 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.101369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.101648 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.101920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.103065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.104521 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.109158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 42/80] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:27.109158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.111386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.112043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.112320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.112589 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.187550 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.189265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.210591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.219174 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ced9-389d-4b85-9563-8334fd20b2e5 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.258049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.258664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.259253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.259543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.260210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] RBAC: Adding query filter params (name=member) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:27.260515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.261949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.272284 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 43/81] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:27.273162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.298545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.300117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 39/82] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:27.301033 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.392360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ad8f2-07f2-4374-a763-1b3b32bcf6fd None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.411925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf452f-85c2-475d-b78f-3d99ad4e81f3 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.428167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.428798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.429075 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.429366 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] PATH_INFO: `/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.429645 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.430498 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] RBAC: Authorizing `identity:get_user(user_id=cce5922f39ab43c1aa73a41f5fc3c2f3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.432026 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.433716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 44/83] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:27 2022] GET /identity/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:27.434461 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.451812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.452447 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.452729 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.453117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.454308 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.455902 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.457722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 40/84] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:27 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:27.458326 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.527489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.540419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd969d7-1ae5-42b1-b0a6-e75aa4ce14ea None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.559243 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813971c0-5533-45ac-aad5-0e4473879e57 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.574078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.574676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.574950 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.575230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.575857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.577368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.594715 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.595706 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.596144 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.596414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.597598 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.599052 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.599279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 45/85] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:38:27 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:27.600110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.600691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 41/86] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:27 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:27.601488 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.685379 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.746516 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3092ec1-86e5-4185-91fa-3719e8bbbf0a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.792566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87aebd1-70a5-4eb3-b655-69059a52d84c None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:27.803340 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.803793 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.805334 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.805334 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.844233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:27.844976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:27.845305 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:27.845586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:27.846795 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.848302 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.850387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 46/87] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:27 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:27.851205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:27.869928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:27.896078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:27.898725 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:27.999926 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a8d72-ee6c-4b80-98e2-8fe3e84ffd6a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.003247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.042992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.043504 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.043784 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.044288 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.067053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 42/88] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:28.067661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.147546 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.149483 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.164684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.200167 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a39285-1c99-4f91-a9d4-b5e6bfe6f66e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.239387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.239774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.240059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.240336 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.263333 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 47/89] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:28.264593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.278373 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.334697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.335715 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.390539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859090-8969-4006-8f44-71edf2202ab0 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.409971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.434682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.435580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.435997 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.436419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.437312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=0b221a3f137341cf93708c3554576822) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:28.437777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.440280 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.449341 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 43/90] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:28.449341 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.451594 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 48/91] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/role_assignments?user.id=0b221a3f137341cf93708c3554576822&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:28.452580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.511830 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.566329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5f3ff-45cf-433e-b050-cb059a77124f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.567306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845c6a-f366-4994-9cce-ce44744fe598 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.605518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.606068 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.606346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.606623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.607083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.607777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.608143 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.608607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.609069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.609282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.610749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.612131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 49/92] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:28.612859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.612976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.619858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 44/93] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:28.621419 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.665397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.731059 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9dd4-6798-4f4f-9dfd-851bc4f76929 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.742151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38918848-2cb9-4988-8386-250605a1e37c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.769576 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.775424 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.776088 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.776365 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.776636 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] PATH_INFO: `/v3/projects/70a21c99655f427e936cc6176e7a3d52` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.777895 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] RBAC: Authorizing `identity:get_project(project_id=70a21c99655f427e936cc6176e7a3d52)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.779394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.781510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 50/94] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/projects/70a21c99655f427e936cc6176e7a3d52 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:28.782229 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.785742 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.787073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.787794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.788391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.789491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] RBAC: Adding query filter params (role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=0b221a3f137341cf93708c3554576822) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:28.790009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.792000 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.798995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 45/95] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/role_assignments?user.id=0b221a3f137341cf93708c3554576822&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:28.800694 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:28.924396 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ffee0-8afc-4f47-93e4-25a1c8b88ae6 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.933805 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33768c2a-9488-40ce-97d9-b2c77f3c224f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:28.953603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:28.970553 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59dbc-b444-4067-b5c8-1b5001eb86c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:28.971560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59dbc-b444-4067-b5c8-1b5001eb86c0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:28.972088 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59dbc-b444-4067-b5c8-1b5001eb86c0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:28.972591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59dbc-b444-4067-b5c8-1b5001eb86c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:28.973882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59dbc-b444-4067-b5c8-1b5001eb86c0 None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=70a21c99655f427e936cc6176e7a3d52, user.id=0b221a3f137341cf93708c3554576822) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:28.974572 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59dbc-b444-4067-b5c8-1b5001eb86c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:28.976490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59dbc-b444-4067-b5c8-1b5001eb86c0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:28.983604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 46/96] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/role_assignments?user.id=0b221a3f137341cf93708c3554576822&scope.project.id=70a21c99655f427e936cc6176e7a3d52&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:29.006855 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253d42b-a25f-4eba-b5ac-907e4b0789d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:29.007495 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253d42b-a25f-4eba-b5ac-907e4b0789d8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:29.007774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253d42b-a25f-4eba-b5ac-907e4b0789d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:29.008047 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253d42b-a25f-4eba-b5ac-907e4b0789d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:29.009126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253d42b-a25f-4eba-b5ac-907e4b0789d8 None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=cce5922f39ab43c1aa73a41f5fc3c2f3) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:29.009440 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253d42b-a25f-4eba-b5ac-907e4b0789d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:29.010930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253d42b-a25f-4eba-b5ac-907e4b0789d8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:29.018753 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 51/97] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:28 2022] GET /identity/v3/role_assignments?user.id=cce5922f39ab43c1aa73a41f5fc3c2f3&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:30.816599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4feec-5dca-4237-9aab-ed6f74b17e97 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:30.817141 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4feec-5dca-4237-9aab-ed6f74b17e97 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:30.817217 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4feec-5dca-4237-9aab-ed6f74b17e97 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:30.818624 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 47/98] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:30.834985 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035b75-d1b3-43ea-82a9-a7379d8ef81d None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:30.836214 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035b75-d1b3-43ea-82a9-a7379d8ef81d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:30.836880 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035b75-d1b3-43ea-82a9-a7379d8ef81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:30.870457 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-80035b75-d1b3-43ea-82a9-a7379d8ef81d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:30.872053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-80035b75-d1b3-43ea-82a9-a7379d8ef81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:30.979799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 52/99] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:31.099982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ac6c-cc44-41c7-babc-d3e7333aa094 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:31.100172 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ac6c-cc44-41c7-babc-d3e7333aa094 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:31.100444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ac6c-cc44-41c7-babc-d3e7333aa094 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:31.101863 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 48/100] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:31.107611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7078-ad5e-4475-9432-a9355af95cf5 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:31.107894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7078-ad5e-4475-9432-a9355af95cf5 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:31.108168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7078-ad5e-4475-9432-a9355af95cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:31.134914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-524d7078-ad5e-4475-9432-a9355af95cf5 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:31.136346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-524d7078-ad5e-4475-9432-a9355af95cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:31.235529 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 53/101] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:31.575480 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89ac6c-cc44-41c7-babc-d3e7333aa094 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:31.644165 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:31.722129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89ac6c-cc44-41c7-babc-d3e7333aa094 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:31.777389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:31.778055 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:31.778464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:31.778747 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:31.799578 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:31.805077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:31.806780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:31.808331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 49/102] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:31.823978 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d7078-ad5e-4475-9432-a9355af95cf5 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:31.907781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:32.005256 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:32.057678 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d7078-ad5e-4475-9432-a9355af95cf5 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:32.103837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e2eb2-ba20-43a2-aea1-0c34467078d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:32.104470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2eb2-ba20-43a2-aea1-0c34467078d1 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.104737 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2eb2-ba20-43a2-aea1-0c34467078d1 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.105011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2eb2-ba20-43a2-aea1-0c34467078d1 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.105730 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e2eb2-ba20-43a2-aea1-0c34467078d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:32.106035 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e2eb2-ba20-43a2-aea1-0c34467078d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:32.107664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e2eb2-ba20-43a2-aea1-0c34467078d1 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:32.124376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 54/103] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:32.125745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cba8f-38df-43ae-941f-930ff842802c None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.126418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cba8f-38df-43ae-941f-930ff842802c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.126601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cba8f-38df-43ae-941f-930ff842802c None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.128598 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 55/104] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:32.135752 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37b5d1-2cb5-4305-be83-4077ecad3e0c None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.136158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37b5d1-2cb5-4305-be83-4077ecad3e0c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.136368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37b5d1-2cb5-4305-be83-4077ecad3e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.170448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-1d37b5d1-2cb5-4305-be83-4077ecad3e0c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:32.171558 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-1d37b5d1-2cb5-4305-be83-4077ecad3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:32.243975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47562-ae33-4f92-959f-4ea3debc547d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:32.277666 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:32.299098 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 56/105] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:32.299655 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37b5d1-2cb5-4305-be83-4077ecad3e0c None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:32.312217 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:32.317136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.317136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.317136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.317136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:32.318363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:32.321306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 50/106] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:32.327243 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:32.382253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:32.451469 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb90dd-0331-4eb1-9735-0d4aff884259 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:32.489499 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c8920-4fa8-47ee-b132-9437c9d21f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:32.490155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8920-4fa8-47ee-b132-9437c9d21f87 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.490435 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8920-4fa8-47ee-b132-9437c9d21f87 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.490905 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8920-4fa8-47ee-b132-9437c9d21f87 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.491571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8920-4fa8-47ee-b132-9437c9d21f87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:32.493020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8920-4fa8-47ee-b132-9437c9d21f87 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:32.525630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 51/107] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:38:32 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:32.527117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bfe8-f072-483b-a505-dd14815b17de None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.527408 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bfe8-f072-483b-a505-dd14815b17de None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.527681 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bfe8-f072-483b-a505-dd14815b17de None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.529287 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 52/108] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:32.537021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa666-ac74-4fd7-8fcc-477c8fd9884a None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.537376 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa666-ac74-4fd7-8fcc-477c8fd9884a None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.537659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa666-ac74-4fd7-8fcc-477c8fd9884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.576724 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-995aa666-ac74-4fd7-8fcc-477c8fd9884a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:32.580740 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-995aa666-ac74-4fd7-8fcc-477c8fd9884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:32.607436 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37b5d1-2cb5-4305-be83-4077ecad3e0c None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:32.648961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:32.709951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1614f3-f14e-44c6-8292-79a07e3883ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:32.710598 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 53/109] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:32.711589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1614f3-f14e-44c6-8292-79a07e3883ea None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.712089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1614f3-f14e-44c6-8292-79a07e3883ea None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.712580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1614f3-f14e-44c6-8292-79a07e3883ea None admin] PATH_INFO: `/v3/users/bef6157f2601497ba144a9f2d0a1a1f4` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.716067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e4f87-e012-4cda-bdc4-230db35c78f6 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.716356 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e4f87-e012-4cda-bdc4-230db35c78f6 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.716689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e4f87-e012-4cda-bdc4-230db35c78f6 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.719206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 54/110] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:32.725397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563caac-430c-4a52-a258-5a0a19231e9c None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.725700 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563caac-430c-4a52-a258-5a0a19231e9c None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.726605 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563caac-430c-4a52-a258-5a0a19231e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.746111 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1614f3-f14e-44c6-8292-79a07e3883ea None admin] RBAC: Authorizing `identity:get_user(user_id=bef6157f2601497ba144a9f2d0a1a1f4)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:32.748016 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1614f3-f14e-44c6-8292-79a07e3883ea None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:32.753367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 57/111] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:32 2022] GET /identity/v3/users/bef6157f2601497ba144a9f2d0a1a1f4 => generated 289 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:32.755168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8645-69a9-4eb4-b19d-89c8fe68d3b5 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.755689 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8645-69a9-4eb4-b19d-89c8fe68d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.756148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8645-69a9-4eb4-b19d-89c8fe68d3b5 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.757739 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 58/112] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:32.760534 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-2563caac-430c-4a52-a258-5a0a19231e9c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:32.761706 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-2563caac-430c-4a52-a258-5a0a19231e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:32.762036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb8645-69a9-4eb4-b19d-89c8fe68d3b5 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:32.859763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 55/113] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:32.861993 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9ab3-045e-4dce-8aa8-9c81901f4ec5 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.862513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9ab3-045e-4dce-8aa8-9c81901f4ec5 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.862972 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9ab3-045e-4dce-8aa8-9c81901f4ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.874325 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:32.885839 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-96ee9ab3-045e-4dce-8aa8-9c81901f4ec5 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:32.887381 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-96ee9ab3-045e-4dce-8aa8-9c81901f4ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:32.894526 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb8645-69a9-4eb4-b19d-89c8fe68d3b5 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:32.935947 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:32.936574 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.936873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.937196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.961388 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 56/114] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:32.962690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee9ab3-045e-4dce-8aa8-9c81901f4ec5 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:32.990275 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:33.025296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:33.027059 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:33.126773 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:33.145528 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 59/115] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:38:33.154673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.163791 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee9ab3-045e-4dce-8aa8-9c81901f4ec5 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.248236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.249088 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.249392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.249742 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.265711 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:33.271981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:33.272924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:33.273731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:33.274317 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 57/116] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:33.274874 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.312534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a86063-bac0-4b57-96e8-593e53fea1e2 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.355276 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.355976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.356264 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.356542 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.358005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:33.359470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:33.361516 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 60/117] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:33.362397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.384040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:33.404974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae830b8-cece-44a3-948e-4cdca706538e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.428829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:33.446490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.447221 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.447542 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.447860 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.462527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:33.467663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:33.470414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 58/118] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:33.473279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.483811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3c3d2-c1fe-4a56-b53e-66df8e932bd8 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.528939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.529532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.529816 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.530084 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.541485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:33.546299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:33.547155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:33.547988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 61/119] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:33.549985 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.587528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7b72b-73b0-41dc-8c7d-c6c2dcf313b4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.629929 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.630605 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.630882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.631207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.631890 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:33.632201 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:33.634019 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:33.643493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 59/120] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:33.648879 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.652698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:33.713146 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff1b1-33e2-4d39-871d-7a985763ce5f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.738125 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:33.764171 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.764777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.765058 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.765391 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.766119 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] RBAC: Adding query filter params (role.id=59835fbc5570419389d43af639ca96b4, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=bef6157f2601497ba144a9f2d0a1a1f4) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:33.766431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:33.767989 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:33.772988 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330f5b4-f569-4066-b5c3-2135c14f0b54 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.785513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 62/121] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/role_assignments?user.id=bef6157f2601497ba144a9f2d0a1a1f4&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=59835fbc5570419389d43af639ca96b4 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:33.785513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.824361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.825615 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.826172 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.826743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.848064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:33.859290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:33.862032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:33.864636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:33.869145 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 60/122] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:33.869145 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:33.939859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f039b-e99f-49cf-bbbf-fd11076a8af7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:33.990753 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:33.991829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:33.992340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:33.992842 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:33.994026 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:33.994593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:33.997047 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.011192 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.015178 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 63/123] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.017890 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.059193 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b3ac-56e2-4b9b-88cd-60413539b990 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.092503 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.130355 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.133080 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.134140 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.134722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.136055 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:34.136813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.140196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.157673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 61/124] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.162927 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.179377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84b7f-bfac-4c25-b5ce-72ad9e8d1faa None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.223708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.224353 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.224695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.224976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.226229 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.227826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.231419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 64/125] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.232142 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.305614 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1e4f-6f30-4648-bd72-974941753cc8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.344533 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.356427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.357273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.357668 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.358064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.358993 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:34.359279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.360766 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.365953 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f83a-e42a-4912-b3cc-edabf92d4e2f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.375133 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 62/126] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.375133 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.382338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.419230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.419922 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.420202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.420474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.422314 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.424794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.427458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 65/127] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.428385 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.487958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20172fd-093d-435a-b2a2-b66219fcce72 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.526756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.527398 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.527673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.527941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] PATH_INFO: `/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.529080 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=cce5922f39ab43c1aa73a41f5fc3c2f3)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.530630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.532348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 63/128] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.534024 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.584924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb69f-a591-44b8-8781-db868e23b250 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.598414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.632184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.633474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.634745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.635197 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.636870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.639320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.641275 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 66/129] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.642416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.664618 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de26a86-4d89-45c1-a621-41c255733cb0 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.702129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.723427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.724463 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.724939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.725434 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.726792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.728684 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.730606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 64/130] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.731645 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.780330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bb6ff-c944-422f-9628-48df61840f8d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.827315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.828342 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.828767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.829567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.831817 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.833527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.835445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 67/131] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.836442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.872623 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f759f8-a5dc-4f81-99c2-b5c5950c464c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.901821 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.914972 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:34.915992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.916477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.917007 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.918491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:34.920201 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:34.922117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 65/132] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:34.923197 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:34.973459 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f8b5-cbc1-4c22-a71a-a541a6b1c27d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:34.991819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:35.026071 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:35.026771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.027298 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.027592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/0b221a3f137341cf93708c3554576822/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.030321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22fba313f3546509a08e2875c4a8c80, user_id=0b221a3f137341cf93708c3554576822, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:35.031821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:35.052523 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1f3a-b0b2-4be7-8b7c-77b6cb845b8f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:35.053940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 68/133] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:34 2022] PUT /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/0b221a3f137341cf93708c3554576822/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:35.055416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:35.163415 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:35.163982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.164261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.164533 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] PATH_INFO: `/v3/projects/70a21c99655f427e936cc6176e7a3d52` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.170006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] RBAC: Authorizing `identity:get_project(project_id=70a21c99655f427e936cc6176e7a3d52)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:35.171557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:35.173926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 66/134] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:34 2022] GET /identity/v3/projects/70a21c99655f427e936cc6176e7a3d52 => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:35.174745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:35.216557 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d95be-fee0-4b6a-862c-e5c6e32b9223 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:35.281477 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:35.282617 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.283386 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.284681 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/0b221a3f137341cf93708c3554576822/roles/76db2368efc54ba8ad85cff0b72339ff` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.287618 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22fba313f3546509a08e2875c4a8c80, user_id=0b221a3f137341cf93708c3554576822, role_id=76db2368efc54ba8ad85cff0b72339ff)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:35.290928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:35.311153 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 69/135] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:35 2022] PUT /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/0b221a3f137341cf93708c3554576822/roles/76db2368efc54ba8ad85cff0b72339ff => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:35.312922 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:35.322384 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:35.368220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:35.422049 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b83ea-5ebd-426d-a6fa-0b621706274e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:35.471492 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb980e0-d2ca-4416-8fa9-8d94b9ef2458 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:35.473327 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414f11f-782c-471c-8c25-06e333170990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:35.474124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f11f-782c-471c-8c25-06e333170990 None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.474409 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f11f-782c-471c-8c25-06e333170990 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.474680 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f11f-782c-471c-8c25-06e333170990 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/cce5922f39ab43c1aa73a41f5fc3c2f3/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.477820 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414f11f-782c-471c-8c25-06e333170990 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22fba313f3546509a08e2875c4a8c80, user_id=cce5922f39ab43c1aa73a41f5fc3c2f3, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:35.479344 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414f11f-782c-471c-8c25-06e333170990 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:35.498095 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 67/136] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:35 2022] PUT /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/cce5922f39ab43c1aa73a41f5fc3c2f3/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:35.499709 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cea0f7-50d8-4ab0-88eb-51cdead68b9b None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.499993 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cea0f7-50d8-4ab0-88eb-51cdead68b9b None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.500300 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cea0f7-50d8-4ab0-88eb-51cdead68b9b None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.502139 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 68/137] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:35.508002 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f113b3-17c1-4c41-83eb-1bbc9ee56157 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.509031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f113b3-17c1-4c41-83eb-1bbc9ee56157 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.509510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f113b3-17c1-4c41-83eb-1bbc9ee56157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.538549 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:35.539666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.540130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.540597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] PATH_INFO: `/v3/projects/70a21c99655f427e936cc6176e7a3d52/users/0b221a3f137341cf93708c3554576822/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.543555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=70a21c99655f427e936cc6176e7a3d52, user_id=0b221a3f137341cf93708c3554576822, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:35.546824 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:35.556064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-29f113b3-17c1-4c41-83eb-1bbc9ee56157 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:35.557615 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-29f113b3-17c1-4c41-83eb-1bbc9ee56157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:35.573639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 70/138] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:35 2022] PUT /identity/v3/projects/70a21c99655f427e936cc6176e7a3d52/users/0b221a3f137341cf93708c3554576822/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:35.650491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 69/139] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:36.113958 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:36.244095 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:36.261132 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d080-367c-4e1c-9d1e-aff5b90e91e0 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:36.295430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c28d1-bef0-4d36-aca2-5c5720793556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:36.296074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c28d1-bef0-4d36-aca2-5c5720793556 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:36.296356 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c28d1-bef0-4d36-aca2-5c5720793556 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:36.296639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c28d1-bef0-4d36-aca2-5c5720793556 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:36.297813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c28d1-bef0-4d36-aca2-5c5720793556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:36.299318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c28d1-bef0-4d36-aca2-5c5720793556 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:36.301202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 71/140] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:36.307390 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f113b3-17c1-4c41-83eb-1bbc9ee56157 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:36.387704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:36.455829 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f113b3-17c1-4c41-83eb-1bbc9ee56157 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:36.508255 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da594ff7-304c-4e41-bf68-827b79328aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:36.509594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594ff7-304c-4e41-bf68-827b79328aa2 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:36.510071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594ff7-304c-4e41-bf68-827b79328aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:36.510563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594ff7-304c-4e41-bf68-827b79328aa2 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:36.511456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da594ff7-304c-4e41-bf68-827b79328aa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:36.513168 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da594ff7-304c-4e41-bf68-827b79328aa2 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:36.555489 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 70/141] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:38:36 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:36.805021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4f7a-9a2a-4dbd-b1d8-7deca1ea09af None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:36.805445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4f7a-9a2a-4dbd-b1d8-7deca1ea09af None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:36.805617 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4f7a-9a2a-4dbd-b1d8-7deca1ea09af None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:36.807199 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 72/142] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:36.817759 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634eb5-e8f5-47b1-809d-bb2762666363 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:36.818477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634eb5-e8f5-47b1-809d-bb2762666363 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:36.818962 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634eb5-e8f5-47b1-809d-bb2762666363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:36.846173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-d2634eb5-e8f5-47b1-809d-bb2762666363 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:36.847752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-d2634eb5-e8f5-47b1-809d-bb2762666363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:36.945118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 71/143] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:37.621700 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4f7a-9a2a-4dbd-b1d8-7deca1ea09af None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:37.773193 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4f7a-9a2a-4dbd-b1d8-7deca1ea09af None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:37.824737 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:37.825417 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:37.825693 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:37.825963 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:37.839186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:37.844129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:37.845222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:37.846022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 73/144] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:37.852929 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2634eb5-e8f5-47b1-809d-bb2762666363 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:37.893996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:37.976604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2634eb5-e8f5-47b1-809d-bb2762666363 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:38.026534 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ba76e-e258-4b3a-b9a9-d865d0e81dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:38.027172 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ba76e-e258-4b3a-b9a9-d865d0e81dfa None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.027457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ba76e-e258-4b3a-b9a9-d865d0e81dfa None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.027733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ba76e-e258-4b3a-b9a9-d865d0e81dfa None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.028410 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ba76e-e258-4b3a-b9a9-d865d0e81dfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:38.028709 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ba76e-e258-4b3a-b9a9-d865d0e81dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:38.030133 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ba76e-e258-4b3a-b9a9-d865d0e81dfa None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:38.041558 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 72/145] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:38.047077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:38.079583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb78b9-0fcf-450e-921d-fe810bb26b77 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.080254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb78b9-0fcf-450e-921d-fe810bb26b77 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.080727 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb78b9-0fcf-450e-921d-fe810bb26b77 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.082421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 73/146] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:38.085441 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:38.088472 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4f26-5098-4ed8-b107-29a509a19658 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.089118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4f26-5098-4ed8-b107-29a509a19658 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.089643 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4f26-5098-4ed8-b107-29a509a19658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.118924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-8bee4f26-5098-4ed8-b107-29a509a19658 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:38.120473 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-8bee4f26-5098-4ed8-b107-29a509a19658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:38.198262 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d835e42-9d36-4d56-b076-04237bdd2f75 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:38.243445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:38.244465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.244949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.245394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] PATH_INFO: `/v3/users/bef6157f2601497ba144a9f2d0a1a1f4` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.247394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=bef6157f2601497ba144a9f2d0a1a1f4)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:38.249193 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:38.251832 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 74/147] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:38 2022] GET /identity/v3/users/bef6157f2601497ba144a9f2d0a1a1f4 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:38.257719 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:38.285809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 74/148] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:38.381498 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:38.399946 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811d3cd-8257-4b6a-b858-44a04866c5a9 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:38.440847 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:38.441528 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.441799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.442066 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.443224 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:38.444679 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:38.448809 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 75/149] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:38 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:38.454716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4f26-5098-4ed8-b107-29a509a19658 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:38.499689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:38.595150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4f26-5098-4ed8-b107-29a509a19658 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:38.647447 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d16b-dbd1-4598-a18e-132288e56ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:38.648499 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d16b-dbd1-4598-a18e-132288e56ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.649063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d16b-dbd1-4598-a18e-132288e56ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.649571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d16b-dbd1-4598-a18e-132288e56ad8 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/bef6157f2601497ba144a9f2d0a1a1f4/roles/59835fbc5570419389d43af639ca96b4` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.654690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1d16b-dbd1-4598-a18e-132288e56ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22fba313f3546509a08e2875c4a8c80, user_id=bef6157f2601497ba144a9f2d0a1a1f4, role_id=59835fbc5570419389d43af639ca96b4)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:38.656624 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1d16b-dbd1-4598-a18e-132288e56ad8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:38.678749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 75/150] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:38 2022] PUT /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80/users/bef6157f2601497ba144a9f2d0a1a1f4/roles/59835fbc5570419389d43af639ca96b4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:38.845656 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:38.872236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c6c69-30c3-4031-96f6-64b961eee39f None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.873337 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c6c69-30c3-4031-96f6-64b961eee39f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.873988 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c6c69-30c3-4031-96f6-64b961eee39f None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.876930 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 76/151] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:38.881594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4362e-ce08-4505-8dac-47c91f2d5c59 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.882190 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4362e-ce08-4505-8dac-47c91f2d5c59 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.882708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4362e-ce08-4505-8dac-47c91f2d5c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.911726 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-66b4362e-ce08-4505-8dac-47c91f2d5c59 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:38.917532 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-66b4362e-ce08-4505-8dac-47c91f2d5c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:38.996162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5808edc-9eea-4290-9d98-a3bbbd203bac None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:39.033720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 77/152] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:39.057933 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cde5e-9a51-4816-9e11-f8b8009f2abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:39.058614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cde5e-9a51-4816-9e11-f8b8009f2abc None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.058894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cde5e-9a51-4816-9e11-f8b8009f2abc None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.059166 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cde5e-9a51-4816-9e11-f8b8009f2abc None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.075197 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cde5e-9a51-4816-9e11-f8b8009f2abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-b60cde5e-9a51-4816-9e11-f8b8009f2abc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:39.080180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:39.081073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:39.082334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 76/153] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:39.089677 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4362e-ce08-4505-8dac-47c91f2d5c59 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:39.119229 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:39.134676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea2a4c-be51-4786-969c-a2321b108d50 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.135025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea2a4c-be51-4786-969c-a2321b108d50 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.135231 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea2a4c-be51-4786-969c-a2321b108d50 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.136908 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 77/154] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:39.142943 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084766-5ffd-42ae-8a64-3091f8e0b089 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.143266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084766-5ffd-42ae-8a64-3091f8e0b089 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.143492 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084766-5ffd-42ae-8a64-3091f8e0b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.174809 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-c4084766-5ffd-42ae-8a64-3091f8e0b089 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:39.176192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-c4084766-5ffd-42ae-8a64-3091f8e0b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:39.194090 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:39.276974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4362e-ce08-4505-8dac-47c91f2d5c59 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:39.306772 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 78/155] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:39.337712 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:39.338365 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.338637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.338906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.339609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:39.339915 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:39.341358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:39.358241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 78/156] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:39.365382 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4084766-5ffd-42ae-8a64-3091f8e0b089 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:39.499668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4084766-5ffd-42ae-8a64-3091f8e0b089 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:39.561579 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f5907-ed4a-4921-b77c-8c66a28dbfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:39.562594 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5907-ed4a-4921-b77c-8c66a28dbfe3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.563222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5907-ed4a-4921-b77c-8c66a28dbfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.563706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5907-ed4a-4921-b77c-8c66a28dbfe3 None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.565255 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f5907-ed4a-4921-b77c-8c66a28dbfe3 None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:39.566922 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f5907-ed4a-4921-b77c-8c66a28dbfe3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:39.568776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 79/157] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:39 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:39.575281 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:39.713596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:39.722405 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187255-5137-49e4-9e9c-6a1ffc075078 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.723120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187255-5137-49e4-9e9c-6a1ffc075078 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.723605 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187255-5137-49e4-9e9c-6a1ffc075078 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.730084 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 80/158] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:39.736826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1be5a3-54fc-4b2a-86b2-fc44e7846b48 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.737474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1be5a3-54fc-4b2a-86b2-fc44e7846b48 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.737953 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1be5a3-54fc-4b2a-86b2-fc44e7846b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.740094 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f7105-42e0-426d-8024-b048649a8e21 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:39.775321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-4d1be5a3-54fc-4b2a-86b2-fc44e7846b48 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:39.777328 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-4d1be5a3-54fc-4b2a-86b2-fc44e7846b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:39.777459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:39.777998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.778271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.778542 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.796719 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:39.852801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:39.854345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:39.909018 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 81/159] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:39.910708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1be5a3-54fc-4b2a-86b2-fc44e7846b48 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:39.939971 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:39.963526 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 79/160] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:38:39.971230 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:40.123276 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708eaa-a8f2-4522-a8ab-5faa7fdb3f03 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:40.132093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1be5a3-54fc-4b2a-86b2-fc44e7846b48 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:40.165357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:40.166008 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:40.166347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:40.166622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:40.168155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:40.169646 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:40.171884 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 80/161] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:39 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:40.172752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:40.197743 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:40.198895 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:40.199506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:40.200005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:40.229583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:40.231240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:40.244278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:40.245235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:40.246014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:40.248527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 82/162] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:40.258123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:40.268551 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:40.302651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544bfe0-e11e-4757-b13e-a8f960029a71 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:40.357914 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:40.358581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:40.358868 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:40.359142 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:40.409885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:40.414756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:40.415678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:40.416506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 81/163] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:40.417198 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:40.424279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8b50-4d7c-43e8-bf76-bfcdf431c6da None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:40.482133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:40.483207 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:40.483687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:40.484165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:40.486545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=0b221a3f137341cf93708c3554576822) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:40.487011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:40.489790 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:40.502862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 83/164] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:40 2022] GET /identity/v3/role_assignments?user.id=0b221a3f137341cf93708c3554576822&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:40.504927 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:40.665596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:40.704211 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0445c8-24c9-496a-b15c-461d83b56d5d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:40.783729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:40.784357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:40.784634 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:40.784904 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:40.785620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] RBAC: Adding query filter params (name=member) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:40.785919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:40.787318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:40.799097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50950ffc-dec0-47a5-9bd2-edb23e326b27 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:40.808518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:40.810672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 84/165] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:40.818180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:40.865855 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:40.866468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:40.866734 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:40.866995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:40.867668 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:40.867963 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:40.869365 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:40.889690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 82/166] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:40.890243 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:41.018827 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018c00-803b-4712-aa31-410129f9823d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:41.085471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:41.101905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:41.102567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.102841 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.103113 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.105155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:41.106640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:41.108627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 85/167] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:40 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:38:41.109085 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:41.123245 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201f07-4382-482a-98e7-1f59454ffca4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:41.206557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:41.207213 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.207487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.207753 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.242978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:41.248367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:41.249315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:41.250199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 83/168] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:38:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:41.250885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:41.320866 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:41.349638 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dc8a9-53e5-425b-b1b7-494f32380883 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:41.437842 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:41.438647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.438924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.439196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] PATH_INFO: `/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.440416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] RBAC: Authorizing `identity:get_user(user_id=cce5922f39ab43c1aa73a41f5fc3c2f3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:41.441946 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:41.443693 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 86/169] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:41 2022] GET /identity/v3/users/cce5922f39ab43c1aa73a41f5fc3c2f3 => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:41.444490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:41.462065 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863877-c600-4c4d-b700-941b20fe1812 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:41.542457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f62eb-1c12-43fa-abbc-4be335828f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:41.543117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f62eb-1c12-43fa-abbc-4be335828f84 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.543401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f62eb-1c12-43fa-abbc-4be335828f84 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.543667 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f62eb-1c12-43fa-abbc-4be335828f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.585170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:41.646164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc86c2e-44cc-4ab3-8a28-920a8b9c6392 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:41.688728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f62eb-1c12-43fa-abbc-4be335828f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:41.690394 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f62eb-1c12-43fa-abbc-4be335828f84 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:41.724492 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:41.725142 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.725428 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.725694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.726385 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:41.726687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:41.728149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:41.747803 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 87/170] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:38:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:41.748706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:41.753860 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:41.864855 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf7faf-dc88-4410-998e-0420622bfc99 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:41.905321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152fdbb-2c91-4c9b-89e3-19d588dfddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:41.905946 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fdbb-2c91-4c9b-89e3-19d588dfddd3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.906609 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fdbb-2c91-4c9b-89e3-19d588dfddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.907136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fdbb-2c91-4c9b-89e3-19d588dfddd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.911892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:41.916364 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 84/171] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:41.921960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233429-f812-4904-9fed-dae301cffadd None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.923260 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233429-f812-4904-9fed-dae301cffadd None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.923564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233429-f812-4904-9fed-dae301cffadd None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.925459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 85/172] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:41.926388 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233429-f812-4904-9fed-dae301cffadd None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:41.996559 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152fdbb-2c91-4c9b-89e3-19d588dfddd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:41.998540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152fdbb-2c91-4c9b-89e3-19d588dfddd3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:42.090728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233429-f812-4904-9fed-dae301cffadd None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:42.121604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:42.134482 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:42.136574 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.137135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.137656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] PATH_INFO: `/v3/users/0b221a3f137341cf93708c3554576822` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.140726 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] RBAC: Authorizing `identity:get_user(user_id=0b221a3f137341cf93708c3554576822)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:42.142893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:42.146455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 86/173] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:41 2022] GET /identity/v3/users/0b221a3f137341cf93708c3554576822 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:42.147798 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:42.277797 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 88/174] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:42.280954 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d6d9-9ae1-40ce-bb93-a03fc90ade7d None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.281280 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d6d9-9ae1-40ce-bb93-a03fc90ade7d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.281548 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d6d9-9ae1-40ce-bb93-a03fc90ade7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.322434 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-0307d6d9-9ae1-40ce-bb93-a03fc90ade7d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:42.323648 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-0307d6d9-9ae1-40ce-bb93-a03fc90ade7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:42.370146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb791083-8241-4578-b3c3-3bbc90910745 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:42.389300 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:42.424163 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:42.424869 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.425161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.425429 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] PATH_INFO: `/v3/projects/70a21c99655f427e936cc6176e7a3d52` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.427109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] RBAC: Authorizing `identity:get_project(project_id=70a21c99655f427e936cc6176e7a3d52)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:42.428361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:42.432485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 87/175] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:42 2022] GET /identity/v3/projects/70a21c99655f427e936cc6176e7a3d52 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:42.432485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:42.445273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 89/176] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:42.446278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307d6d9-9ae1-40ce-bb93-a03fc90ade7d None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:42.530000 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:42.591794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfed8f-f879-486e-b4e1-9ef3ef544566 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:42.612596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307d6d9-9ae1-40ce-bb93-a03fc90ade7d None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:42.675672 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:42.676325 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.676664 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.676928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.696225 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:42.696913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.697215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.697485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.702192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:42.703912 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:42.708237 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 90/177] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:42 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:42.708946 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:42.772019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:42.802056 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:42.804115 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:42.879418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:42.899768 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b16ed8-5c0f-4a5f-a9e2-1b7034fca05a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:42.942612 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08284427-c7c6-466c-b4ab-8b79e1412cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:42.943108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08284427-c7c6-466c-b4ab-8b79e1412cb7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.943376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08284427-c7c6-466c-b4ab-8b79e1412cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.948681 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08284427-c7c6-466c-b4ab-8b79e1412cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.948872 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 88/178] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:42.948965 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08284427-c7c6-466c-b4ab-8b79e1412cb7 None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=70a21c99655f427e936cc6176e7a3d52, user.id=0b221a3f137341cf93708c3554576822) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:42.949050 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:42.949196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08284427-c7c6-466c-b4ab-8b79e1412cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:42.949196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08284427-c7c6-466c-b4ab-8b79e1412cb7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:42.954975 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 91/179] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:42 2022] GET /identity/v3/role_assignments?user.id=0b221a3f137341cf93708c3554576822&scope.project.id=70a21c99655f427e936cc6176e7a3d52&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:42.954975 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba73c9-e78e-4cfe-b9f5-6798b588dfb4 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.956447 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba73c9-e78e-4cfe-b9f5-6798b588dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.956713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba73c9-e78e-4cfe-b9f5-6798b588dfb4 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.958760 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 92/180] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:42.960230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd677bb-0dcf-4e7d-8ff2-8e8eebaac5b7 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.960515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd677bb-0dcf-4e7d-8ff2-8e8eebaac5b7 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.960814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd677bb-0dcf-4e7d-8ff2-8e8eebaac5b7 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.962615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 93/181] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:42.963564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd677bb-0dcf-4e7d-8ff2-8e8eebaac5b7 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:43.109949 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be8bc-e10f-4d2a-b4ab-506f26036f8b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.115847 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.145937 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd677bb-0dcf-4e7d-8ff2-8e8eebaac5b7 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.165689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:43.166332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.166554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.166736 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.167586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=cce5922f39ab43c1aa73a41f5fc3c2f3) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:43.167781 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:43.169311 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:43.177886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 89/182] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:42 2022] GET /identity/v3/role_assignments?user.id=cce5922f39ab43c1aa73a41f5fc3c2f3&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:43.177886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:43.198182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da317ea-77eb-4b43-9215-b8453c7d8148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:43.198761 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da317ea-77eb-4b43-9215-b8453c7d8148 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.199027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da317ea-77eb-4b43-9215-b8453c7d8148 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.199310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da317ea-77eb-4b43-9215-b8453c7d8148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.214465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da317ea-77eb-4b43-9215-b8453c7d8148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-4da317ea-77eb-4b43-9215-b8453c7d8148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:43.219670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:43.221330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 94/183] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:43.224046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e6b9-b931-4190-a1b3-0c3ab8fcfb03 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.226140 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e6b9-b931-4190-a1b3-0c3ab8fcfb03 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.227168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e6b9-b931-4190-a1b3-0c3ab8fcfb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.227441 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.255848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-1f49e6b9-b931-4190-a1b3-0c3ab8fcfb03 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:43.255848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-1f49e6b9-b931-4190-a1b3-0c3ab8fcfb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:43.350185 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c2fe5-b8ea-4402-b6f7-2523b336dbaf None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.361812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 95/184] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:43.361812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f44b8-3f31-4c70-9a8d-ff3e49b9bd1b None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.361812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f44b8-3f31-4c70-9a8d-ff3e49b9bd1b None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.361812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f44b8-3f31-4c70-9a8d-ff3e49b9bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.381118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-940f44b8-3f31-4c70-9a8d-ff3e49b9bd1b None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:43.382598 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-940f44b8-3f31-4c70-9a8d-ff3e49b9bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:43.396139 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc176ca-735a-42e0-ae84-b9ca4cdf3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:43.397035 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc176ca-735a-42e0-ae84-b9ca4cdf3460 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.397526 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc176ca-735a-42e0-ae84-b9ca4cdf3460 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.397925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc176ca-735a-42e0-ae84-b9ca4cdf3460 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.399342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc176ca-735a-42e0-ae84-b9ca4cdf3460 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:43.401158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc176ca-735a-42e0-ae84-b9ca4cdf3460 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:43.403160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 90/185] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:43 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:43.404727 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4a04e-75dd-4468-9874-eecadb5e28d1 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.405316 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4a04e-75dd-4468-9874-eecadb5e28d1 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.405750 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4a04e-75dd-4468-9874-eecadb5e28d1 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.407667 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 91/186] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:43.408717 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4a04e-75dd-4468-9874-eecadb5e28d1 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:43.476869 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 96/187] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:43.478532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f44b8-3f31-4c70-9a8d-ff3e49b9bd1b None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:43.491746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.548181 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.562152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4a04e-75dd-4468-9874-eecadb5e28d1 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.627255 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac8cf-3c74-4499-865e-a2f0e338a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:43.627926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac8cf-3c74-4499-865e-a2f0e338a523 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.628378 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac8cf-3c74-4499-865e-a2f0e338a523 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.628886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac8cf-3c74-4499-865e-a2f0e338a523 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.630042 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ac8cf-3c74-4499-865e-a2f0e338a523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:43.630532 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ac8cf-3c74-4499-865e-a2f0e338a523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:43.633031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ac8cf-3c74-4499-865e-a2f0e338a523 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:43.651322 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 92/188] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:43.659786 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c74eb-014b-499f-ad95-f4f5f3502d50 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.660311 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c74eb-014b-499f-ad95-f4f5f3502d50 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.660762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c74eb-014b-499f-ad95-f4f5f3502d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.663394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f44b8-3f31-4c70-9a8d-ff3e49b9bd1b None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.699504 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-7c9c74eb-014b-499f-ad95-f4f5f3502d50 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:43.701530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-7c9c74eb-014b-499f-ad95-f4f5f3502d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:43.730524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:43.731853 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.732717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.733394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.735434 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] RBAC: Adding query filter params (role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=0b221a3f137341cf93708c3554576822) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:43.736232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:43.739472 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:43.751538 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 97/189] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:43 2022] GET /identity/v3/role_assignments?user.id=0b221a3f137341cf93708c3554576822&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:43.753653 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:43.828905 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 93/190] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:43.830719 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c74eb-014b-499f-ad95-f4f5f3502d50 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:43.875897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.910638 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898ac0-8207-4deb-acbe-9ee5af765fc3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.957175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:43.958324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.958632 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.958913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] PATH_INFO: `/v3/users/4149643640864e2680c01ad9f35a6746` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.960115 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.981152 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] RBAC: Authorizing `identity:get_user(user_id=4149643640864e2680c01ad9f35a6746)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:43.983967 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:43.986771 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c74eb-014b-499f-ad95-f4f5f3502d50 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.987217 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 98/191] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:43 2022] GET /identity/v3/users/4149643640864e2680c01ad9f35a6746 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:43.988260 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.049265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.049940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.050214 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.050481 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.073278 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:44.078846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:44.079814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:44.080609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 94/192] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:38:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:44.081314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.132177 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dbcdf-3416-4fcd-b9ee-dff1d78dea7b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.166572 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.174344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.174987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.175294 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.175532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.176732 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.178245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.180008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 99/193] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:44.180712 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.210181 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a54d0-0448-4c4d-b6ea-3b349a1ac829 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.252806 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.253456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.253732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.253995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.275683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.301007 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54896a7-0f5c-43f7-926c-cda42c47da28 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.330724 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.332763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.337796 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.338400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.338672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.338941 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.339600 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:44.339890 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.341287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.350053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 100/194] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:44.350914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.419237 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.450687 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 95/195] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:44.451641 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.473041 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d676-d33b-474b-9c99-1bbc6fbbde17 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.503466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.520177 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.521080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.521515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.521842 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.534504 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:44.540201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:44.541375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 101/196] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:44.542292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.566155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e05b37-04ab-4bd0-9b29-6c42189c598e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.603365 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.603974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.604248 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.604513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.605181 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.606621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.628305 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 96/197] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:38:44 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:44.630080 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.670029 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24568994-05ba-4431-a866-a10dfe5e97a6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.708736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.725765 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.726414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.726695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.726958 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] PATH_INFO: `/v3/users/4149643640864e2680c01ad9f35a6746` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.728263 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] RBAC: Authorizing `identity:get_user(user_id=4149643640864e2680c01ad9f35a6746)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.730051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.731726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 102/198] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/users/4149643640864e2680c01ad9f35a6746 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:44.734512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.783098 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5af93-0b18-4734-a512-75c73489485f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.787315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.836188 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.836845 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.837130 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.837404 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.838656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.840117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.842046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 97/199] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:44.842664 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.872494 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34016ce-11dd-4af0-93bf-2be72d519113 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.915848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.916732 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.917012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.917781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.918453 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] RBAC: Adding query filter params (name=reader) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:44.918786 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.920218 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.930254 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 103/200] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:44.931208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.985467 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef0b7-f3cc-4faa-8bc8-6a2918fc7327 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:45.009839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:45.038216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:45.039230 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.039594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.039861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.083905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88250-6cf7-4a76-9843-9d1bb6a07fee None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:45.129324 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:45.138931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:45.139717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.140025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.140235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.141169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=4149643640864e2680c01ad9f35a6746) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:45.141487 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:45.142980 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:45.149689 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 104/201] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/role_assignments?user.id=4149643640864e2680c01ad9f35a6746&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:45.150348 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:45.173008 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:45.174999 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:45.343638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 98/202] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:45.354348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:45.439978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:45.445848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dde474-2ee2-4f27-aa38-f306192f3c04 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:45.490032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec67855-d567-474e-9500-46c4132fcbb9 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:45.497458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:45.531990 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:45.532650 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.532927 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.533232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] PATH_INFO: `/v3/users/bef6157f2601497ba144a9f2d0a1a1f4` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.535946 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] RBAC: Authorizing `identity:get_user(user_id=bef6157f2601497ba144a9f2d0a1a1f4)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:45.537456 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:45.539124 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 105/203] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:45 2022] GET /identity/v3/users/bef6157f2601497ba144a9f2d0a1a1f4 => generated 289 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:45.545655 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:45.562205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:45.562960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.563386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.563764 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.567011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:45.568478 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:45.570228 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 99/204] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:45 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:45.578186 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:45.762225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3533-d3c9-4d1a-a7f7-c733e2866622 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:45.787141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59d889-067c-4cf2-933b-2688cf9807aa None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:45.805337 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:45.805988 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.806262 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.806532 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.807336 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] RBAC: Adding query filter params (role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=4149643640864e2680c01ad9f35a6746) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:45.807712 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:45.813129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:45.818948 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 100/205] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:45 2022] GET /identity/v3/role_assignments?user.id=4149643640864e2680c01ad9f35a6746&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:45.846727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:45.847430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.847717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.848079 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.916461 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:45.941316 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:45.944309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:46.105632 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 106/206] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:46.111592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:46.115760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:46.263108 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99035-ff04-483c-8c96-766a6c77f56a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:46.318580 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced87aa-f97d-445d-b86a-6de8d8d9aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:46.319606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced87aa-f97d-445d-b86a-6de8d8d9aa7f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:46.320103 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced87aa-f97d-445d-b86a-6de8d8d9aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:46.320563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced87aa-f97d-445d-b86a-6de8d8d9aa7f None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:46.325924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced87aa-f97d-445d-b86a-6de8d8d9aa7f None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:46.327695 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced87aa-f97d-445d-b86a-6de8d8d9aa7f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:46.329807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 101/207] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:46 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:46.336142 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:46.513841 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:46.518015 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf95bd0-b4cd-4e14-a258-e6c019c1aa68 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:46.585054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90484a-c4e9-4666-b6aa-b32d95e3619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:46.586223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90484a-c4e9-4666-b6aa-b32d95e3619f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:46.586691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90484a-c4e9-4666-b6aa-b32d95e3619f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:46.587162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90484a-c4e9-4666-b6aa-b32d95e3619f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:46.588645 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90484a-c4e9-4666-b6aa-b32d95e3619f None admin] RBAC: Adding query filter params (role.id=59835fbc5570419389d43af639ca96b4, scope.project.id=c22fba313f3546509a08e2875c4a8c80, user.id=bef6157f2601497ba144a9f2d0a1a1f4) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:46.589223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90484a-c4e9-4666-b6aa-b32d95e3619f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:46.592063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90484a-c4e9-4666-b6aa-b32d95e3619f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:46.604206 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 107/208] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:46 2022] GET /identity/v3/role_assignments?user.id=bef6157f2601497ba144a9f2d0a1a1f4&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=59835fbc5570419389d43af639ca96b4 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:47.712583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96757-c190-41d7-9b1f-50a65b9c7314 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:47.713142 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96757-c190-41d7-9b1f-50a65b9c7314 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:47.713377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96757-c190-41d7-9b1f-50a65b9c7314 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:47.714971 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 102/209] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:47.721386 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f25b1-d946-483b-8a28-6691a49a15ee None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:47.721920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f25b1-d946-483b-8a28-6691a49a15ee None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:47.721920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f25b1-d946-483b-8a28-6691a49a15ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:47.742920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-7a9f25b1-d946-483b-8a28-6691a49a15ee None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:47.744186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-7a9f25b1-d946-483b-8a28-6691a49a15ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:47.828995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 108/210] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:47.929686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8252e-0d8b-48e5-80ec-3b65bb738df2 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:47.930002 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8252e-0d8b-48e5-80ec-3b65bb738df2 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:47.930232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8252e-0d8b-48e5-80ec-3b65bb738df2 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:47.931909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 103/211] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:47.938063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2716d1-d598-4a00-8c7d-b783a8ddccdf None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:47.938566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2716d1-d598-4a00-8c7d-b783a8ddccdf None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:47.939152 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2716d1-d598-4a00-8c7d-b783a8ddccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:47.960770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-de2716d1-d598-4a00-8c7d-b783a8ddccdf None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:47.962044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-de2716d1-d598-4a00-8c7d-b783a8ddccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:48.038873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 109/212] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:48.122785 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a83ce3-664b-4e19-9033-70aa9e5b7623 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.123128 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a83ce3-664b-4e19-9033-70aa9e5b7623 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.123338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a83ce3-664b-4e19-9033-70aa9e5b7623 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.124708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 104/213] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:48.134018 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd3cdd-acdd-4e93-8289-fc87d3d0aaa5 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.134352 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd3cdd-acdd-4e93-8289-fc87d3d0aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.134583 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd3cdd-acdd-4e93-8289-fc87d3d0aaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.155358 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-46fd3cdd-acdd-4e93-8289-fc87d3d0aaa5 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:48.156650 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-46fd3cdd-acdd-4e93-8289-fc87d3d0aaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:48.159023 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:48.215941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a83ce3-664b-4e19-9033-70aa9e5b7623 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:48.253129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 110/214] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:48.340402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:48.391515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd3cdd-acdd-4e93-8289-fc87d3d0aaa5 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:48.394591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a83ce3-664b-4e19-9033-70aa9e5b7623 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:48.464277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb791283-c8e4-47da-85ed-e156afc89501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:48.465296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb791283-c8e4-47da-85ed-e156afc89501 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.465579 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb791283-c8e4-47da-85ed-e156afc89501 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.465843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb791283-c8e4-47da-85ed-e156afc89501 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.488745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb791283-c8e4-47da-85ed-e156afc89501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-eb791283-c8e4-47da-85ed-e156afc89501 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:48.497653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:48.499395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:48.501071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:48.508040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 105/215] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:48.510580 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec290acf-8090-4712-b080-90d4a792f4a7 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.511059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec290acf-8090-4712-b080-90d4a792f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.511437 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec290acf-8090-4712-b080-90d4a792f4a7 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.513576 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 106/216] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:48.514661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec290acf-8090-4712-b080-90d4a792f4a7 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:48.567212 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd3cdd-acdd-4e93-8289-fc87d3d0aaa5 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:48.615598 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bce6e-3696-4f3e-8ba0-32d1d1714807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:48.616274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bce6e-3696-4f3e-8ba0-32d1d1714807 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.616675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bce6e-3696-4f3e-8ba0-32d1d1714807 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.616950 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bce6e-3696-4f3e-8ba0-32d1d1714807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.625775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:48.636941 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bce6e-3696-4f3e-8ba0-32d1d1714807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-847bce6e-3696-4f3e-8ba0-32d1d1714807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:48.642049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:48.649274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 111/217] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:38:48.650631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb718b-8f52-442a-ab74-62352f04763b None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.653329 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb718b-8f52-442a-ab74-62352f04763b None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.653329 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb718b-8f52-442a-ab74-62352f04763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.666811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-5eeb718b-8f52-442a-ab74-62352f04763b None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:48.668059 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-5eeb718b-8f52-442a-ab74-62352f04763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:48.673132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec290acf-8090-4712-b080-90d4a792f4a7 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:48.727927 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:48.735495 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:48.736206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.736545 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.736921 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.737875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:48.738257 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:48.739982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:48.748309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 112/218] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:48.749219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb718b-8f52-442a-ab74-62352f04763b None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:48.751302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 107/219] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:48.751981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:48.891624 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb718b-8f52-442a-ab74-62352f04763b None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:48.924583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649317c4-65aa-4dea-a274-015356004d1b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:48.938915 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:48.949711 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:48.950350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.950619 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.950882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.952056 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:48.953675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:48.955383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 113/220] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:48.956193 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:48.989638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:48.990264 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:48.990570 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:48.991571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.992247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:48.992545 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:48.994189 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:49.008868 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 108/221] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:49.010134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.104908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:49.123301 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7972f4-36c6-4b3b-a55b-801134769eb6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:49.159739 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0e5e-db93-4b35-9dc4-c8a72ceb526f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:49.166400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:49.167070 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.167353 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.167621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] PATH_INFO: `/v3/users/dec8381219834ca8b14f702ff3556917` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.184959 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] RBAC: Authorizing `identity:get_user(user_id=dec8381219834ca8b14f702ff3556917)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:49.186519 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:49.188615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 114/222] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:48 2022] GET /identity/v3/users/dec8381219834ca8b14f702ff3556917 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:49.189895 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.208048 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:49.208668 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.208939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.209245 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.209909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:49.211392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:49.236851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 109/223] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:38:49 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:49.237430 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.285309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:49.353858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406009-010c-4755-92dc-f970cd6a40c5 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:49.378643 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ca77e-b4c5-4073-832f-706870f5cc41 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:49.401005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:49.401005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.401005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.401410 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] PATH_INFO: `/v3/users/4149643640864e2680c01ad9f35a6746` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.404275 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] RBAC: Authorizing `identity:get_user(user_id=4149643640864e2680c01ad9f35a6746)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:49.404455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:49.404533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:49.410774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 115/224] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:49 2022] GET /identity/v3/users/4149643640864e2680c01ad9f35a6746 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:49.410774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.438614 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:49.439525 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.440486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.440486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.459102 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:49.466292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:49.467216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:49.468012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 110/225] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:38:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:49.468680 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.576277 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a404-7f03-4b97-91f4-2d388a03ef05 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:49.616523 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:49.628523 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64d937-f2af-44c9-ba4c-fb4a56cf5f6f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:49.646478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:49.646478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.646478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.646478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.695885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:49.696863 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.697211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.697556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.699470 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:49.707672 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:49.709970 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 111/226] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:49 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:49.710983 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.741134 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:49.742833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:49.788939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:49.853279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f2ac-492f-48ae-97eb-63544ac5fec0 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:49.861520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 116/227] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:49.862413 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.890332 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:49.908942 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:49.910060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.910633 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.911109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.912459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:49.914245 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:49.915760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:49.926451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 112/228] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:38:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:49.927783 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:49.994472 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60187e3-84d3-43a9-a4f7-3a4eeca38f30 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:50.036746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:50.037467 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:50.037756 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:50.038052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/4149643640864e2680c01ad9f35a6746/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:50.040141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user_id=4149643640864e2680c01ad9f35a6746, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:50.041830 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:50.047457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b045e-2bd9-4e6a-b6d3-66593c4c4381 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:50.049857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:50.060569 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 117/229] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:49 2022] PUT /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/4149643640864e2680c01ad9f35a6746/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:50.061851 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:50.124226 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:50.125011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:50.125471 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:50.125815 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:50.131381 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:50.132418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:50.135555 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 113/230] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:49 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:50.141266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:50.199173 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:50.224045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0087951-c9b4-4b7c-927a-bef8d2d10777 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:50.269288 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:50.270448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:50.270932 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:50.271399 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] PATH_INFO: `/v3/users/4149643640864e2680c01ad9f35a6746` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:50.272983 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=4149643640864e2680c01ad9f35a6746)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:50.274797 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:50.277977 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 118/231] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:50 2022] GET /identity/v3/users/4149643640864e2680c01ad9f35a6746 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:50.292009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:50.372058 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106b7ca-00d4-40cc-a6e0-fe7554bcddcb None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:50.478336 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:50.479736 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:50.479847 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:50.480290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:50.481567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=dec8381219834ca8b14f702ff3556917) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:50.482105 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:50.498409 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:50.516400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9ab96-1171-4926-84c8-50a01bdc5ed3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:50.524302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 114/232] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:50 2022] GET /identity/v3/role_assignments?user.id=dec8381219834ca8b14f702ff3556917&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 259 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:50.563163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81376696-ae52-4f79-9633-a22b249c1bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:50.564213 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376696-ae52-4f79-9633-a22b249c1bc0 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:50.564702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376696-ae52-4f79-9633-a22b249c1bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:50.565195 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376696-ae52-4f79-9633-a22b249c1bc0 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:50.566626 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81376696-ae52-4f79-9633-a22b249c1bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:50.568366 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81376696-ae52-4f79-9633-a22b249c1bc0 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:50.570388 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 119/233] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:50 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:50.577768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:50.652527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:50.764694 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f040c-41d3-45a0-9064-ae454afc4656 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:50.821983 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09921b24-f81c-4db8-8924-1ed0658c0a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:50.822781 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09921b24-f81c-4db8-8924-1ed0658c0a2f None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:50.822965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09921b24-f81c-4db8-8924-1ed0658c0a2f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:50.823241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09921b24-f81c-4db8-8924-1ed0658c0a2f None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/4149643640864e2680c01ad9f35a6746/roles/76db2368efc54ba8ad85cff0b72339ff` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:50.825711 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09921b24-f81c-4db8-8924-1ed0658c0a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user_id=4149643640864e2680c01ad9f35a6746, role_id=76db2368efc54ba8ad85cff0b72339ff)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:50.827222 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09921b24-f81c-4db8-8924-1ed0658c0a2f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:50.851254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 115/234] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:50 2022] PUT /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/4149643640864e2680c01ad9f35a6746/roles/76db2368efc54ba8ad85cff0b72339ff => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:52.087336 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857616b-5a11-4a8a-8e64-0af4bddb814a None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:52.087871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857616b-5a11-4a8a-8e64-0af4bddb814a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:52.087871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857616b-5a11-4a8a-8e64-0af4bddb814a None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:52.089289 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 120/235] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:52.104691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981968e-7503-448c-a7d9-7b2b291edabc None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:52.105246 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981968e-7503-448c-a7d9-7b2b291edabc None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:52.105681 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981968e-7503-448c-a7d9-7b2b291edabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:52.143957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-6981968e-7503-448c-a7d9-7b2b291edabc None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:52.145242 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-6981968e-7503-448c-a7d9-7b2b291edabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:52.250452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 116/236] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:52.426376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6922ade-426b-42ea-92c6-4f5f00ed87c0 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:52.426739 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6922ade-426b-42ea-92c6-4f5f00ed87c0 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:52.427025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6922ade-426b-42ea-92c6-4f5f00ed87c0 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:52.428712 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 121/237] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:52.435274 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7fe3b-ba2f-4e84-a59f-d191b656a8b0 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:52.435650 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7fe3b-ba2f-4e84-a59f-d191b656a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:52.436109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7fe3b-ba2f-4e84-a59f-d191b656a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:52.479012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-39c7fe3b-ba2f-4e84-a59f-d191b656a8b0 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:52.481183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-39c7fe3b-ba2f-4e84-a59f-d191b656a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:52.525836 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:52.636971 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 117/238] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:52.712637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6922ade-426b-42ea-92c6-4f5f00ed87c0 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:52.754856 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:52.913619 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6922ade-426b-42ea-92c6-4f5f00ed87c0 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:52.976208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8331-c10d-408f-a30d-b65a91e19dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:52.976789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8331-c10d-408f-a30d-b65a91e19dc1 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:52.977067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8331-c10d-408f-a30d-b65a91e19dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:52.977369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8331-c10d-408f-a30d-b65a91e19dc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:52.989991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b8331-c10d-408f-a30d-b65a91e19dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-3a9b8331-c10d-408f-a30d-b65a91e19dc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:52.995060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:52.996054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:52.996928 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 122/239] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:53.002561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7fe3b-ba2f-4e84-a59f-d191b656a8b0 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:53.156765 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7fe3b-ba2f-4e84-a59f-d191b656a8b0 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:53.221867 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:53.223422 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.224275 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.225080 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.226295 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:53.226400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc657f-2d13-43f9-adf4-987e5ef96c60 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.226813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc657f-2d13-43f9-adf4-987e5ef96c60 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.226883 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:53.226951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc657f-2d13-43f9-adf4-987e5ef96c60 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.228512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 123/240] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:53.228995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:53.236614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9572-6c67-49b1-9c6a-1a6b3f72970a None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.236614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9572-6c67-49b1-9c6a-1a6b3f72970a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.236614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9572-6c67-49b1-9c6a-1a6b3f72970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.239861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 118/241] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:53.245596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:53.270461 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:53.287051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9b5d9572-6c67-49b1-9c6a-1a6b3f72970a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:53.288587 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9b5d9572-6c67-49b1-9c6a-1a6b3f72970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:53.384710 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea429b8-e3e4-4180-9361-3861e33338f8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:53.387168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 124/242] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:53.389146 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d9572-6c67-49b1-9c6a-1a6b3f72970a None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:53.402648 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:53.465367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:53.466274 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.466548 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.466821 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] PATH_INFO: `/v3/users/952edd4343ad4e6ca5ac2ffdca22020b` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.507116 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] RBAC: Authorizing `identity:get_user(user_id=952edd4343ad4e6ca5ac2ffdca22020b)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:53.508976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:53.511358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 119/243] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:53 2022] GET /identity/v3/users/952edd4343ad4e6ca5ac2ffdca22020b => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:53.518502 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:53.597700 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d9572-6c67-49b1-9c6a-1a6b3f72970a None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:53.679360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:53.682404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af1da1-2898-419a-b46f-96eb2b30a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:53.683096 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af1da1-2898-419a-b46f-96eb2b30a131 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.683373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af1da1-2898-419a-b46f-96eb2b30a131 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.683641 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af1da1-2898-419a-b46f-96eb2b30a131 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.687834 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af1da1-2898-419a-b46f-96eb2b30a131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:53.690080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af1da1-2898-419a-b46f-96eb2b30a131 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:53.697214 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 125/244] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:53.698763 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaa72d-f24e-42f2-8153-22c11424a214 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.699310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaa72d-f24e-42f2-8153-22c11424a214 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.699668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaa72d-f24e-42f2-8153-22c11424a214 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.701356 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 126/245] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:53.702035 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaa72d-f24e-42f2-8153-22c11424a214 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:53.727171 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690d205-e833-478d-b61e-884d37e9d881 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:53.770496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:53.771027 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.771301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.771571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.807786 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:53.844421 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaa72d-f24e-42f2-8153-22c11424a214 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:53.863914 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:53.866090 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:53.900925 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98282-5b94-40d1-9c75-37f443b1d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:53.902029 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98282-5b94-40d1-9c75-37f443b1d4fc None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.902562 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98282-5b94-40d1-9c75-37f443b1d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.903057 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98282-5b94-40d1-9c75-37f443b1d4fc None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.904296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98282-5b94-40d1-9c75-37f443b1d4fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:53.907186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98282-5b94-40d1-9c75-37f443b1d4fc None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:53.941227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 127/246] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:38:53 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:53.941227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805b437-aea1-4163-ae1b-08a124aeca34 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.941227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805b437-aea1-4163-ae1b-08a124aeca34 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.941227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805b437-aea1-4163-ae1b-08a124aeca34 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.941227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 128/247] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:53.946538 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adab2d-5412-4f41-891c-25738957dbee None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.947062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adab2d-5412-4f41-891c-25738957dbee None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.947062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adab2d-5412-4f41-891c-25738957dbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.967062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-e2adab2d-5412-4f41-891c-25738957dbee None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:53.967844 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:53.968369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-e2adab2d-5412-4f41-891c-25738957dbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:54.007395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 120/248] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:38:54.008775 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.065798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 129/249] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:54.067408 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a51bf-28ec-40e1-a3da-c2ffa2f9305a None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:54.067685 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a51bf-28ec-40e1-a3da-c2ffa2f9305a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:54.067952 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a51bf-28ec-40e1-a3da-c2ffa2f9305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:54.094702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-399a51bf-28ec-40e1-a3da-c2ffa2f9305a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:54.096102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-399a51bf-28ec-40e1-a3da-c2ffa2f9305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:54.165987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1efe-3ecc-4c48-950a-5afaf79f9804 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:54.178746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:54.201303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 130/250] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:54.203523 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a51bf-28ec-40e1-a3da-c2ffa2f9305a None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.225829 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:54.226778 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:54.227308 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:54.229321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:54.271152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:54.278655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:54.279607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:38:54.280382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:54.281922 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 121/251] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:54.290102 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.371912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:54.434959 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a51bf-28ec-40e1-a3da-c2ffa2f9305a None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:54.485065 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a8ec-30fe-473d-b1fd-cf0557f088c2 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:54.502057 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:54.503154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:54.503642 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:54.504126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:54.506268 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:54.509449 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:54.511835 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 131/252] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:54.512758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.537974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:54.539052 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:54.539547 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:54.540013 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:54.540910 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:54.541597 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:54.543466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:54.555145 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 122/253] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:54.556585 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.620187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:54.670167 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:54.680540 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c23b5-2270-4325-b88d-e02ecfd456c7 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:54.699551 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f86eb-49f1-4353-b558-2e95ae29ca88 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:54.723131 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:54.723769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:54.724050 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:54.724311 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:54.725372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] RBAC: Adding query filter params (role.id=59835fbc5570419389d43af639ca96b4, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=952edd4343ad4e6ca5ac2ffdca22020b) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:54.725674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:54.727333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:54.734106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 123/254] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/role_assignments?user.id=952edd4343ad4e6ca5ac2ffdca22020b&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=59835fbc5570419389d43af639ca96b4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:54.741180 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.782460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:54.783400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:54.783717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:54.784156 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:54.834827 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:54.852585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:54.855442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 132/255] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:54.858445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.872160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03abd2-c627-4dc7-9be5-f0b0f89dda5a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:54.914991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:54.915652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:54.915923 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:54.916192 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] PATH_INFO: `/v3/users/4149643640864e2680c01ad9f35a6746` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:54.917597 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] RBAC: Authorizing `identity:get_user(user_id=4149643640864e2680c01ad9f35a6746)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:54.919316 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:54.921154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 124/256] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/users/4149643640864e2680c01ad9f35a6746 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:54.922402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:54.978314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.033273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dcaed-3e49-42c9-87b3-3d6b5edc563f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.058809 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.075252 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d07e3-e2e6-4767-a8d0-ec02f17769aa None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.076168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.076818 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.077114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.077393 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.091414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:55.097767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:55.099008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 133/257] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:38:55.099889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.121319 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.122495 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.122908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.123361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.124260 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:55.124703 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:55.126389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:55.137477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 125/258] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:55.138722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.256397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ab47f-0063-4e71-8ff5-9c9b545ea58f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.264218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.277217 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426f6bd-8066-4524-8e94-b4250163d78c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.298449 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.299084 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.299359 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.299628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.326236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.327139 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.327552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.328004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.329151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:55.329745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:55.331755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:55.341798 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 126/259] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:55.343027 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.365221 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.436072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:55.438628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:55.461377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dfa05-4495-44c8-ae1d-9e1fc1201874 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.497677 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.498557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.498990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.499397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] PATH_INFO: `/v3/users/dec8381219834ca8b14f702ff3556917` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.500792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] RBAC: Authorizing `identity:get_user(user_id=dec8381219834ca8b14f702ff3556917)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:55.502530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:55.504369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 127/260] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:55 2022] GET /identity/v3/users/dec8381219834ca8b14f702ff3556917 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:55.505341 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.530407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.624401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc83a5-4488-4a41-affc-e102e1459f5e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.662665 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.663566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.664119 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.664544 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] PATH_INFO: `/v3/users/4149643640864e2680c01ad9f35a6746` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.665863 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] RBAC: Authorizing `identity:get_user(user_id=4149643640864e2680c01ad9f35a6746)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:55.667481 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:55.669552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 128/261] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:55 2022] GET /identity/v3/users/4149643640864e2680c01ad9f35a6746 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:55.670510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.728082 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 134/262] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:55.729071 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.777081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.786250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce578e6-d6e7-4965-9935-3aac39cb6d4d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.824444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.825501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.826023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.826487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.828050 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:55.830115 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:55.832671 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 129/263] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:55 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:55.833873 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.940296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.953168 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36905570-668c-48f3-8bf1-25596229d60b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:55.989955 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:55.991031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.991527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.992004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.993457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:55.995206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:55.997413 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 130/264] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:55 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:55.998447 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:55.999552 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c606121-b088-4576-a12e-c8b711620984 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:56.040869 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:56.096882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:56.097640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:56.097924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:56.098210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:56.116221 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66943514-24eb-4567-94ed-853c4f9bb713 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:56.155432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:56.156552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:56.157014 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:56.157704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/dec8381219834ca8b14f702ff3556917/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:56.160106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] RBAC: Authorizing `identity:create_grant(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user_id=dec8381219834ca8b14f702ff3556917, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:56.161870 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:56.186492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 131/265] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:55 2022] PUT /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/dec8381219834ca8b14f702ff3556917/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:56.190420 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:56.218358 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:56.220762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:56.449521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:56.453329 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:56.494792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57f5e-0024-4c97-ad49-e360d800196c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:56.513524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 135/266] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:38:56.519640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:56.589355 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:56.589999 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:56.590274 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:56.590541 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:56.591280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=4149643640864e2680c01ad9f35a6746) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:56.591596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:56.593118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:56.611393 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 132/267] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:56 2022] GET /identity/v3/role_assignments?user.id=4149643640864e2680c01ad9f35a6746&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 608 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:56.679431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9260f9-7d03-446a-a13c-f3667612f84a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:56.721217 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f7431-b0cc-4eb0-b196-763f093aab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:56.721775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7431-b0cc-4eb0-b196-763f093aab4d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:56.722049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7431-b0cc-4eb0-b196-763f093aab4d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:56.722320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7431-b0cc-4eb0-b196-763f093aab4d None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:56.723546 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f7431-b0cc-4eb0-b196-763f093aab4d None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:56.725062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f7431-b0cc-4eb0-b196-763f093aab4d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:56.726893 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 136/268] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:56 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:56.732851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:56.884350 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b39787-336c-41e5-9e86-27d5556c7c26 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:56.935140 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168c5ef-3423-4372-91b7-d165159756fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:56.935764 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c5ef-3423-4372-91b7-d165159756fb None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:56.936037 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c5ef-3423-4372-91b7-d165159756fb None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:56.936303 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c5ef-3423-4372-91b7-d165159756fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:56.937036 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168c5ef-3423-4372-91b7-d165159756fb None admin] RBAC: Adding query filter params (role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=4149643640864e2680c01ad9f35a6746) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:56.937462 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168c5ef-3423-4372-91b7-d165159756fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:56.939891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168c5ef-3423-4372-91b7-d165159756fb None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:56.951205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 133/269] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:38:56 2022] GET /identity/v3/role_assignments?user.id=4149643640864e2680c01ad9f35a6746&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:57.219170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b572-2f58-411c-a273-2be506de9754 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:57.219561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b572-2f58-411c-a273-2be506de9754 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:57.219734 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b572-2f58-411c-a273-2be506de9754 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:57.221456 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 137/270] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:57.227550 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ca88-ecec-4202-a4b5-b584af750c6b None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:57.227829 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ca88-ecec-4202-a4b5-b584af750c6b None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:57.228100 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ca88-ecec-4202-a4b5-b584af750c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:57.257279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-d571ca88-ecec-4202-a4b5-b584af750c6b None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:57.257279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-d571ca88-ecec-4202-a4b5-b584af750c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:57.270419 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:57.362477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 134/271] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:57.540160 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b475e-ad7e-4671-89c5-35031ea9daa9 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:57.540657 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b475e-ad7e-4671-89c5-35031ea9daa9 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:57.540657 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b475e-ad7e-4671-89c5-35031ea9daa9 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:57.542202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 138/272] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:57.549604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c661d8-d53d-4897-ba75-579668c50a1a None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:57.550549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c661d8-d53d-4897-ba75-579668c50a1a None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:57.551021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c661d8-d53d-4897-ba75-579668c50a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:57.581232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-91c661d8-d53d-4897-ba75-579668c50a1a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:57.582886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-91c661d8-d53d-4897-ba75-579668c50a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:57.700342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 135/273] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:57.734896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b475e-ad7e-4671-89c5-35031ea9daa9 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:57.793159 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:57.853668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b475e-ad7e-4671-89c5-35031ea9daa9 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:57.892635 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:57.893706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:57.894180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:57.894643 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:57.895998 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:57.897716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:57.899922 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 139/274] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:38:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:57.905507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c661d8-d53d-4897-ba75-579668c50a1a None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:57.991302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:58.036507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c661d8-d53d-4897-ba75-579668c50a1a None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:58.042489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:58.077259 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5751-f63c-4c23-8a60-4a0857a69d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:58.079117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5751-f63c-4c23-8a60-4a0857a69d25 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.079578 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5751-f63c-4c23-8a60-4a0857a69d25 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.080018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5751-f63c-4c23-8a60-4a0857a69d25 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.081068 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5751-f63c-4c23-8a60-4a0857a69d25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:58.082992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5751-f63c-4c23-8a60-4a0857a69d25 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:58.112163 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 136/275] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:38:57 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:38:58.190228 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9596100-01a2-45d7-9d2d-febee9c10557 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:58.195369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26290-1f06-40b3-8878-6998508b03a0 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.195705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26290-1f06-40b3-8878-6998508b03a0 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.195923 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26290-1f06-40b3-8878-6998508b03a0 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.197426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 137/276] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:58.204646 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686816e-a08f-42f8-bc4a-0a04b6141027 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.205079 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686816e-a08f-42f8-bc4a-0a04b6141027 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.205496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686816e-a08f-42f8-bc4a-0a04b6141027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.223480 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:58.227674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-6686816e-a08f-42f8-bc4a-0a04b6141027 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:58.229307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-6686816e-a08f-42f8-bc4a-0a04b6141027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:58.241435 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:58.243767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.243767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.243767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.257799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:58.263118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:58.264187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:38:58.264949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 140/277] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:38:58.270674 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:58.344472 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 138/278] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:38:58.411114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4a415-5b29-4846-9b45-4c126f289e14 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:58.452530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:58.453732 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.454211 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.454673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.455568 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:58.456100 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:58.457774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:58.467889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 141/279] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:58.474158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686816e-a08f-42f8-bc4a-0a04b6141027 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:58.553638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:58.620011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686816e-a08f-42f8-bc4a-0a04b6141027 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:58.657775 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:58.658461 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.658794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.659072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] PATH_INFO: `/v3/users/8675c045d8f948eb8998d52f223096d3` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.675249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] RBAC: Authorizing `identity:get_user(user_id=8675c045d8f948eb8998d52f223096d3)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:58.676882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:58.679096 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 139/280] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:58 2022] GET /identity/v3/users/8675c045d8f948eb8998d52f223096d3 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:58.684735 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:58.740161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:58.752030 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:58.837021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f691-5426-4b24-9fbd-181f2f8eadb0 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:58.883993 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e184267-bf64-46ba-9340-6709a5d55b93 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:58.887105 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:58.888011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.888497 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.888965 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.889933 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, user.id=8675c045d8f948eb8998d52f223096d3, scope.system=all) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:58.890496 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:58.892372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:58.902209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:58.911146 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 142/281] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 22 20:38:58 2022] GET /identity/v3/role_assignments?user.id=8675c045d8f948eb8998d52f223096d3&scope.system=all&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:58.921589 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:58.922263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.922539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.922811 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.935205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:38:58.940466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:38:58.941392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:38:58.942206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 140/282] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:38:58.948912 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:59.106348 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb1f49-727a-411c-95ab-e503ad1ce741 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:59.109452 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:59.147241 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176d32-e365-4823-8be1-cbced5b4ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:59.147769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176d32-e365-4823-8be1-cbced5b4ac42 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:59.148045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176d32-e365-4823-8be1-cbced5b4ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:59.148315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176d32-e365-4823-8be1-cbced5b4ac42 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:59.148991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176d32-e365-4823-8be1-cbced5b4ac42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:38:59.149327 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176d32-e365-4823-8be1-cbced5b4ac42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:59.150738 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176d32-e365-4823-8be1-cbced5b4ac42 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:59.160596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 143/283] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:38:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:59.166156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:59.205389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fcdf5-642e-476a-893c-6432c4afbd00 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:59.205855 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fcdf5-642e-476a-893c-6432c4afbd00 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:59.206207 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fcdf5-642e-476a-893c-6432c4afbd00 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:59.207935 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 144/284] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:59.213505 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301d48-4e11-4d92-9687-e1a087876531 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:59.213870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301d48-4e11-4d92-9687-e1a087876531 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:59.214208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301d48-4e11-4d92-9687-e1a087876531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:59.236425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-73301d48-4e11-4d92-9687-e1a087876531 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:59.236425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-73301d48-4e11-4d92-9687-e1a087876531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:59.314623 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16bfcf-1c88-48ba-90bb-8a3f03f7e355 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:59.344239 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 145/285] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:38:59.374494 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:59.375235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:59.375526 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:59.375835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] PATH_INFO: `/v3/users/952edd4343ad4e6ca5ac2ffdca22020b` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:59.378114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] RBAC: Authorizing `identity:get_user(user_id=952edd4343ad4e6ca5ac2ffdca22020b)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:59.379640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:59.385794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 141/286] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:38:59 2022] GET /identity/v3/users/952edd4343ad4e6ca5ac2ffdca22020b => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:59.391261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301d48-4e11-4d92-9687-e1a087876531 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:59.535690 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:59.543468 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301d48-4e11-4d92-9687-e1a087876531 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:59.601955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:59.602597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:59.602868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:59.603128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:59.609518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:59.611006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:59.612674 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 146/287] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:38:59 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:38:59.618806 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:59.691265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:59.767409 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050616e-e94b-40a3-96eb-d62aaa2c7ccb None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:59.810189 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:59.830298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:59.831621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:59.832117 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:59.832683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/952edd4343ad4e6ca5ac2ffdca22020b/roles/59835fbc5570419389d43af639ca96b4` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:59.837002 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] RBAC: Authorizing `identity:create_grant(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user_id=952edd4343ad4e6ca5ac2ffdca22020b, role_id=59835fbc5570419389d43af639ca96b4)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:59.840038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:59.868619 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 142/288] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:38:59 2022] PUT /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/users/952edd4343ad4e6ca5ac2ffdca22020b/roles/59835fbc5570419389d43af639ca96b4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:38:59.985077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf5898-c213-4b65-b20f-81e4869a1438 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:00.035039 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:00.035777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:00.036060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:00.036331 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:00.055278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:00.064163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:00.065107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:00.065918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:00.069771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 147/289] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:39:00.077315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:00.222822 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd2ad1-cd97-4bc9-8066-c83c7b1601fd None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:00.225707 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:00.261409 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:00.262101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:00.262375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:00.262643 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:00.263331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:00.263627 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:00.265025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:00.276893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 143/290] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:00.282973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:00.339665 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:00.460123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda5f3-10a0-4217-a47b-776008caec1d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:00.515697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:00.516429 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:00.516739 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:00.517013 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] PATH_INFO: `/v3/users/dec8381219834ca8b14f702ff3556917` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:00.522108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] RBAC: Authorizing `identity:get_user(user_id=dec8381219834ca8b14f702ff3556917)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:00.523690 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:00.525626 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 148/291] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:39:00 2022] GET /identity/v3/users/dec8381219834ca8b14f702ff3556917 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:00.531545 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:00.671066 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630508ff-1545-4ac2-a13a-bc94e4cfe841 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:00.725146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7147e-a335-4293-afad-641c7193701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:00.726064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7147e-a335-4293-afad-641c7193701c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:00.726510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7147e-a335-4293-afad-641c7193701c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:00.726947 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7147e-a335-4293-afad-641c7193701c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:00.762892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:00.811492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7147e-a335-4293-afad-641c7193701c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:00.813488 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7147e-a335-4293-afad-641c7193701c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:00.941893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 144/292] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:00.947628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:00.993451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c728-169b-457d-a5dc-234d4f2a1d81 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:00.994116 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c728-169b-457d-a5dc-234d4f2a1d81 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:00.994573 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c728-169b-457d-a5dc-234d4f2a1d81 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:00.996383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 145/293] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:01.002415 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb562cc-561c-423e-a40b-8ca6043ede6a None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.002998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb562cc-561c-423e-a40b-8ca6043ede6a None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.003476 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb562cc-561c-423e-a40b-8ca6043ede6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.042250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-7cb562cc-561c-423e-a40b-8ca6043ede6a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:01.043833 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-7cb562cc-561c-423e-a40b-8ca6043ede6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:01.077135 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978b83-4c33-4b2f-ab86-d74a4c0d7717 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:01.094155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:01.109968 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:01.110749 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.111186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.111808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.113584 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:01.115275 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:01.117816 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 149/294] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:00 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:01.126345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:01.190238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:01.206542 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 146/295] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:01.303761 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fffc-c6b8-4f2b-ae6a-4848474013c7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:01.363360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077d5f7-7bb6-498c-8d08-c1196571047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:01.363983 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d5f7-7bb6-498c-8d08-c1196571047f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.364261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d5f7-7bb6-498c-8d08-c1196571047f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.364527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d5f7-7bb6-498c-8d08-c1196571047f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.365283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077d5f7-7bb6-498c-8d08-c1196571047f None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=dec8381219834ca8b14f702ff3556917) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:01.365585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077d5f7-7bb6-498c-8d08-c1196571047f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:01.367028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077d5f7-7bb6-498c-8d08-c1196571047f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:01.378614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 150/296] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:01 2022] GET /identity/v3/role_assignments?user.id=dec8381219834ca8b14f702ff3556917&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:01.573509 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0d589-61c2-4d95-90d7-c87c888494e0 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.573879 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0d589-61c2-4d95-90d7-c87c888494e0 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.574038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0d589-61c2-4d95-90d7-c87c888494e0 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.575767 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 147/297] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:01.581948 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc8d7-6cca-428b-bcdd-b75c97d19f83 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.582213 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc8d7-6cca-428b-bcdd-b75c97d19f83 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.582481 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc8d7-6cca-428b-bcdd-b75c97d19f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.606285 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-c79fc8d7-6cca-428b-bcdd-b75c97d19f83 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:01.607490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-c79fc8d7-6cca-428b-bcdd-b75c97d19f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:01.626938 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:01.696321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0d589-61c2-4d95-90d7-c87c888494e0 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:01.701504 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 151/298] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:01.827448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0d589-61c2-4d95-90d7-c87c888494e0 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:01.869475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:01.870127 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.870453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.870728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.884634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:01.889640 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:01.890592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:01.892022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 148/299] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:01.900654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc8d7-6cca-428b-bcdd-b75c97d19f83 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:02.029056 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc8d7-6cca-428b-bcdd-b75c97d19f83 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:02.072777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:02.073859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.074345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.074810 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.076019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:02.076550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:02.079270 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:02.093939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:02.096703 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 152/300] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:02.102830 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:02.137346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:02.174716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:02.239749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1845-c8b1-45e9-907a-af34b90a2670 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:02.262310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fefb7d-19b5-4b34-abab-236ca5384909 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:02.291335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f14ad-c343-4e9d-901f-a23bcde747ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:02.292229 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f14ad-c343-4e9d-901f-a23bcde747ea None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.292501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f14ad-c343-4e9d-901f-a23bcde747ea None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.292773 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f14ad-c343-4e9d-901f-a23bcde747ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.293933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f14ad-c343-4e9d-901f-a23bcde747ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:02.295391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f14ad-c343-4e9d-901f-a23bcde747ea None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:02.297695 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 149/301] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:02.298836 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f2f8-33c4-449a-89ef-980f26f575fc None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.299118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f2f8-33c4-449a-89ef-980f26f575fc None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.299387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f2f8-33c4-449a-89ef-980f26f575fc None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.300726 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 150/302] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:02.306941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2973a-4ed3-413d-8fb4-9b84b1bff94d None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.307254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2973a-4ed3-413d-8fb4-9b84b1bff94d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.307617 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2973a-4ed3-413d-8fb4-9b84b1bff94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.310839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:02.311849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.312400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.312551 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] PATH_INFO: `/v3/users/3b03d6534c89469d9fe7f1aa79fa0172` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.328934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-42b2973a-4ed3-413d-8fb4-9b84b1bff94d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:02.329557 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] RBAC: Authorizing `identity:get_user(user_id=3b03d6534c89469d9fe7f1aa79fa0172)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:02.330412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-42b2973a-4ed3-413d-8fb4-9b84b1bff94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:02.331347 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:02.341708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 153/303] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:39:02 2022] GET /identity/v3/users/3b03d6534c89469d9fe7f1aa79fa0172 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:02.341708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:02.438072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 151/304] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:02.439638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2973a-4ed3-413d-8fb4-9b84b1bff94d None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:02.453894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:02.495248 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4b32f-e7be-4873-aa87-3e6c25001cbb None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:02.546496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:02.549758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3da95-4281-496d-9a02-c4f3dbd2a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:02.550810 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3da95-4281-496d-9a02-c4f3dbd2a297 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.551325 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3da95-4281-496d-9a02-c4f3dbd2a297 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.552450 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3da95-4281-496d-9a02-c4f3dbd2a297 None admin] PATH_INFO: `/v3/groups` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.553503 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3da95-4281-496d-9a02-c4f3dbd2a297 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:02.555132 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3da95-4281-496d-9a02-c4f3dbd2a297 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:02.583657 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 154/305] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Aug 22 20:39:02 2022] POST /identity/v3/groups => generated 229 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:39:02.620961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2973a-4ed3-413d-8fb4-9b84b1bff94d None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:02.659814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d65b9-d4f0-4f3e-bcd2-9ebe7f6983ee None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.660149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d65b9-d4f0-4f3e-bcd2-9ebe7f6983ee None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.660372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d65b9-d4f0-4f3e-bcd2-9ebe7f6983ee None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.661804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 155/306] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:02.667853 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c472-986c-4a3a-b91d-1d4399e74a41 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.668221 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c472-986c-4a3a-b91d-1d4399e74a41 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.668425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c472-986c-4a3a-b91d-1d4399e74a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.676073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:02.677449 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.678007 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.678498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.679554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] RBAC: Adding query filter params (role.id=59835fbc5570419389d43af639ca96b4, user.id=3b03d6534c89469d9fe7f1aa79fa0172, scope.system=all) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:02.680238 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:02.682066 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:02.688653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 152/307] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 22 20:39:02 2022] GET /identity/v3/role_assignments?user.id=3b03d6534c89469d9fe7f1aa79fa0172&scope.system=all&role.id=59835fbc5570419389d43af639ca96b4 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:02.694383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-78b2c472-986c-4a3a-b91d-1d4399e74a41 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:02.695843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-78b2c472-986c-4a3a-b91d-1d4399e74a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:02.788813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 156/308] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:02.828077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:02.943100 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472c2ee-2faa-4d07-aa04-0d321723c0ed None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:02.963072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:02.981495 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:02.982154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.982430 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.982700 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.995570 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:03.000551 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:03.001518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:03.002306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 153/309] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:03.008188 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c472-986c-4a3a-b91d-1d4399e74a41 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:03.072292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:03.116610 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c472-986c-4a3a-b91d-1d4399e74a41 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:03.123160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:03.156836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:03.157484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:03.157756 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:03.158023 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:03.158696 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] RBAC: Adding query filter params (name=member) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:03.159019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:03.160498 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:03.174181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 157/310] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:03.175439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:03.246218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e58b0-8842-4594-8fb0-73705f9de73f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:03.295860 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:03.297689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:03.298060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:03.298342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:03.313728 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e545a-b762-41ca-b90d-efe8081bd402 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:03.315149 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:03.321010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:03.321995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:03.331021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 154/311] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:03.339092 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:03.370221 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:03.387300 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:03.387951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:03.388224 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:03.388504 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] PATH_INFO: `/v3/users/8675c045d8f948eb8998d52f223096d3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:03.390434 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] RBAC: Authorizing `identity:get_user(user_id=8675c045d8f948eb8998d52f223096d3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:03.392706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:03.405122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 158/312] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:39:03 2022] GET /identity/v3/users/8675c045d8f948eb8998d52f223096d3 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:03.409913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:03.434045 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:03.502406 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2250a6-20d9-4dfe-b246-13f746a2f28b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:03.541019 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:03.542064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:03.542535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:03.542990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:03.543858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:03.544363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:03.546010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:03.556080 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 155/313] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:03.563090 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:03.593383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142111e2-3754-4456-8cd4-eb1b56c20f48 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:03.637278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:03.638403 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:03.638403 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:03.638568 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] PATH_INFO: `/v3/system/users/8675c045d8f948eb8998d52f223096d3/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:03.640415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8675c045d8f948eb8998d52f223096d3, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:03.643244 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:03.659337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 159/314] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Aug 22 20:39:03 2022] PUT /identity/v3/system/users/8675c045d8f948eb8998d52f223096d3/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:03.680748 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:03.689599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18e9b-dee5-46e8-9df0-f81276a51d72 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:03.733060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:03.734451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:03.735158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:03.735643 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] PATH_INFO: `/v3/users/952edd4343ad4e6ca5ac2ffdca22020b` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:03.737335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] RBAC: Authorizing `identity:get_user(user_id=952edd4343ad4e6ca5ac2ffdca22020b)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:03.739166 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:03.741303 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 156/315] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:39:03 2022] GET /identity/v3/users/952edd4343ad4e6ca5ac2ffdca22020b => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:03.748788 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:03.824905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:03.889566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4f90-3f7b-499d-b250-4015adf6584f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:03.930827 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:03.931035 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:03.931380 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:03.931551 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.008581 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:04.010083 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:04.066842 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:04.118589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 160/316] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:04.120709 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:04.228745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840642-d49c-4e0c-9a16-bdd9b095d491 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:04.264803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff1608-61d9-4ec0-bd0d-aa2ce8820d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:04.265608 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1608-61d9-4ec0-bd0d-aa2ce8820d9f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:04.266180 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1608-61d9-4ec0-bd0d-aa2ce8820d9f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:04.266273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1608-61d9-4ec0-bd0d-aa2ce8820d9f None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.267398 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff1608-61d9-4ec0-bd0d-aa2ce8820d9f None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:04.268833 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff1608-61d9-4ec0-bd0d-aa2ce8820d9f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:04.273189 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 157/317] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:04 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:04.277343 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:04.387431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014bdb9-1ad5-4b84-91ea-53e9e3b4214c None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:04.423073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d99d7-c764-4378-9b55-b8aa14770621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:04.423718 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d99d7-c764-4378-9b55-b8aa14770621 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:04.423990 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d99d7-c764-4378-9b55-b8aa14770621 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:04.424259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d99d7-c764-4378-9b55-b8aa14770621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.424990 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d99d7-c764-4378-9b55-b8aa14770621 None admin] RBAC: Adding query filter params (role.id=59835fbc5570419389d43af639ca96b4, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5, user.id=952edd4343ad4e6ca5ac2ffdca22020b) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:04.425322 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d99d7-c764-4378-9b55-b8aa14770621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:04.427027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d99d7-c764-4378-9b55-b8aa14770621 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:04.441285 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 161/318] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:04 2022] GET /identity/v3/role_assignments?user.id=952edd4343ad4e6ca5ac2ffdca22020b&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=59835fbc5570419389d43af639ca96b4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:04.907064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc3fbe-2eb9-4979-9174-85c13574650e None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:04.907367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc3fbe-2eb9-4979-9174-85c13574650e None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:04.907636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc3fbe-2eb9-4979-9174-85c13574650e None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.908953 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 158/319] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:04.914567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e76b-7f41-4bfc-b81b-b27a61f65c9f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:04.914921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e76b-7f41-4bfc-b81b-b27a61f65c9f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:04.915265 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e76b-7f41-4bfc-b81b-b27a61f65c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.936368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-00e7e76b-7f41-4bfc-b81b-b27a61f65c9f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:04.937862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-00e7e76b-7f41-4bfc-b81b-b27a61f65c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:04.958725 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:05.020231 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 162/320] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:05.107096 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9856-4334-48ac-8d5e-8c8d8dfe672b None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:05.107673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9856-4334-48ac-8d5e-8c8d8dfe672b None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:05.108241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9856-4334-48ac-8d5e-8c8d8dfe672b None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:05.116778 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 159/321] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:05.118766 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ad8c-4b49-4e7c-bf68-e32d46892953 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:05.119387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ad8c-4b49-4e7c-bf68-e32d46892953 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:05.119387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ad8c-4b49-4e7c-bf68-e32d46892953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:05.141185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-3010ad8c-4b49-4e7c-bf68-e32d46892953 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:05.142149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-3010ad8c-4b49-4e7c-bf68-e32d46892953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:05.225195 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 163/322] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:05.360026 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d9856-4334-48ac-8d5e-8c8d8dfe672b None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:05.402594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:05.475838 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d9856-4334-48ac-8d5e-8c8d8dfe672b None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:05.519571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:05.520215 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:05.520493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:05.520763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:05.521900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:05.523391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:05.525498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 160/323] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:05.531023 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ad8c-4b49-4e7c-bf68-e32d46892953 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:05.545828 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:05.625065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:05.651205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ad8c-4b49-4e7c-bf68-e32d46892953 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:05.669479 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86a1f-4f84-4eef-b7b0-42fe7162fb65 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:05.673571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:05.708783 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:05.710503 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:05.711090 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:05.711533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] PATH_INFO: `/v3/groups` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:05.713267 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:05.715227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:05.723146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:05.723797 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:05.724104 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:05.724341 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:05.734141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 164/324] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Aug 22 20:39:05 2022] POST /identity/v3/groups => generated 226 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:39:05.741815 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:05.747465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:05.748639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:05.754132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 161/325] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:39:05.759609 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:05.925058 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b3309-a895-40bc-8fec-1afd8edcdca8 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:05.970062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e4ac3-ff1f-4985-b3a8-661bc7bee4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:05.970694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4ac3-ff1f-4985-b3a8-661bc7bee4a4 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:05.970975 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4ac3-ff1f-4985-b3a8-661bc7bee4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:05.971244 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4ac3-ff1f-4985-b3a8-661bc7bee4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:05.971949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e4ac3-ff1f-4985-b3a8-661bc7bee4a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:05.972256 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e4ac3-ff1f-4985-b3a8-661bc7bee4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:05.973732 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e4ac3-ff1f-4985-b3a8-661bc7bee4a4 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:05.983562 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 165/326] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:05.990491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:06.080942 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9118e66-3572-4ac5-b469-8480bdb70b01 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.081368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9118e66-3572-4ac5-b469-8480bdb70b01 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.081561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9118e66-3572-4ac5-b469-8480bdb70b01 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.083227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 166/327] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:06.088882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ba4a-5323-49a6-a0d1-99d7301a718e None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.089289 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ba4a-5323-49a6-a0d1-99d7301a718e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.089641 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ba4a-5323-49a6-a0d1-99d7301a718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.098104 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:06.113049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-1830ba4a-5323-49a6-a0d1-99d7301a718e None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:06.114350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-1830ba4a-5323-49a6-a0d1-99d7301a718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:06.141431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd959ed3-30e4-4adc-ae9e-b06953e49aeb None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:06.185664 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:06.186351 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.186645 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.186939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] PATH_INFO: `/v3/users/3b03d6534c89469d9fe7f1aa79fa0172` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.188277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=3b03d6534c89469d9fe7f1aa79fa0172)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:06.189891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:06.192648 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 162/328] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:39:05 2022] GET /identity/v3/users/3b03d6534c89469d9fe7f1aa79fa0172 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:06.199236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:06.221185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 167/329] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:06.250288 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:06.354236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1695-29ba-4339-97c1-588d48da1cf8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:06.399453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:06.400498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.400498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.400752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] PATH_INFO: `/v3/system/users/3b03d6534c89469d9fe7f1aa79fa0172/roles/59835fbc5570419389d43af639ca96b4` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.402161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3b03d6534c89469d9fe7f1aa79fa0172, role_id=59835fbc5570419389d43af639ca96b4)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:06.403556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:06.416884 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 163/330] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Aug 22 20:39:06 2022] PUT /identity/v3/system/users/3b03d6534c89469d9fe7f1aa79fa0172/roles/59835fbc5570419389d43af639ca96b4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:39:06.576522 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830ba4a-5323-49a6-a0d1-99d7301a718e None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:06.699908 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830ba4a-5323-49a6-a0d1-99d7301a718e None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:06.733644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:06.740044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:06.740690 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.740973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.742522 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.755052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:06.760287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:06.762389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:06.764266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 168/331] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:06.767784 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:06.877631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:06.883940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7ac6-244d-44fb-abd5-e4d39b9aa6bd None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:06.929694 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:06.930328 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.930603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.930915 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.931597 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:06.931896 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:06.933345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:06.946325 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 164/332] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:06.952263 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:07.069030 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a650ab2-35ba-4dd2-a02c-5299fca9aabe None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:07.116739 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced691f-44f7-489d-ada7-1c3b3ba27afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:07.117421 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced691f-44f7-489d-ada7-1c3b3ba27afe None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:07.117699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced691f-44f7-489d-ada7-1c3b3ba27afe None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:07.117972 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced691f-44f7-489d-ada7-1c3b3ba27afe None admin] PATH_INFO: `/v3/users/8675c045d8f948eb8998d52f223096d3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:07.122326 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced691f-44f7-489d-ada7-1c3b3ba27afe None admin] RBAC: Authorizing `identity:get_user(user_id=8675c045d8f948eb8998d52f223096d3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:07.124025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced691f-44f7-489d-ada7-1c3b3ba27afe None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:07.126050 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 169/333] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:39:06 2022] GET /identity/v3/users/8675c045d8f948eb8998d52f223096d3 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:07.132484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:07.297406 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7d4c-37c4-49b4-896b-3aeb6240b042 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:07.348688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc6343-8dc9-4b89-8cdb-7a343e5c115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:07.349342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc6343-8dc9-4b89-8cdb-7a343e5c115f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:07.349622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc6343-8dc9-4b89-8cdb-7a343e5c115f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:07.350373 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc6343-8dc9-4b89-8cdb-7a343e5c115f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:07.350776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc6343-8dc9-4b89-8cdb-7a343e5c115f None admin] RBAC: Adding query filter params (role.id=ecb9b0fc60ff48f4aec62bb80c281b54, user.id=8675c045d8f948eb8998d52f223096d3, scope.system=all) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:07.351094 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc6343-8dc9-4b89-8cdb-7a343e5c115f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:07.352656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc6343-8dc9-4b89-8cdb-7a343e5c115f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:07.371815 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 165/334] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 22 20:39:07 2022] GET /identity/v3/role_assignments?user.id=8675c045d8f948eb8998d52f223096d3&scope.system=all&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 510 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:08.970155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a62fe-48ca-452e-9dbb-098b020fbf9e None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:08.970741 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a62fe-48ca-452e-9dbb-098b020fbf9e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:08.970825 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a62fe-48ca-452e-9dbb-098b020fbf9e None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:08.972606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 170/335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:08.991491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361f3c-82bb-4fc6-b4a4-386989b4e5d7 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:08.992018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361f3c-82bb-4fc6-b4a4-386989b4e5d7 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:08.992018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361f3c-82bb-4fc6-b4a4-386989b4e5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:09.022481 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-fe361f3c-82bb-4fc6-b4a4-386989b4e5d7 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:09.023964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-fe361f3c-82bb-4fc6-b4a4-386989b4e5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:09.038873 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:09.119066 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 166/336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:09.222586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1e1b-bc7e-4cfc-a603-d3649837d914 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:09.222789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1e1b-bc7e-4cfc-a603-d3649837d914 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:09.223041 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1e1b-bc7e-4cfc-a603-d3649837d914 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:09.225198 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 171/337] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:09.231484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7376d02-b114-4956-b68c-848a9442fed6 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:09.231792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7376d02-b114-4956-b68c-848a9442fed6 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:09.232037 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7376d02-b114-4956-b68c-848a9442fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:09.258566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b7376d02-b114-4956-b68c-848a9442fed6 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:09.259799 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b7376d02-b114-4956-b68c-848a9442fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:09.350022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 167/338] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:09.544582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c1e1b-bc7e-4cfc-a603-d3649837d914 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:09.627845 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:09.685808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c1e1b-bc7e-4cfc-a603-d3649837d914 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:09.735742 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:09.736409 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:09.736687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:09.736959 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:09.756131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:09.761531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:09.762471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:09.763249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 172/339] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:39:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:09.771861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7376d02-b114-4956-b68c-848a9442fed6 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:09.834797 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:09.932720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:09.983254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7376d02-b114-4956-b68c-848a9442fed6 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:10.046892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:10.047805 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.047907 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.048160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.048861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:10.049188 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:10.050631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:10.051164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b3ba-561e-45c1-865c-aad2891cf485 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:10.071404 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 168/340] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:10.078284 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:10.083823 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:10.110961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02540e-bdb9-44c4-bd0b-efd1be88782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:10.112155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02540e-bdb9-44c4-bd0b-efd1be88782c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.112641 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02540e-bdb9-44c4-bd0b-efd1be88782c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.113131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02540e-bdb9-44c4-bd0b-efd1be88782c None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.133959 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02540e-bdb9-44c4-bd0b-efd1be88782c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-5c02540e-bdb9-44c4-bd0b-efd1be88782c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:10.141043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:10.142002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:10.142789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 173/341] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:10.145136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92850b03-0ccd-48d3-bd59-ced5d86147eb None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.145136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92850b03-0ccd-48d3-bd59-ced5d86147eb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.145136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92850b03-0ccd-48d3-bd59-ced5d86147eb None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.146149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 174/342] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:10.147885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e388b-4ec8-4cb2-8f48-250e916f669d None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.148222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e388b-4ec8-4cb2-8f48-250e916f669d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.148495 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e388b-4ec8-4cb2-8f48-250e916f669d None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.151664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 175/343] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:10.152493 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e388b-4ec8-4cb2-8f48-250e916f669d None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:10.241590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82122a-bf96-41c7-b9b3-d754e913f872 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:10.283232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e388b-4ec8-4cb2-8f48-250e916f669d None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:10.283976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f96725-bd64-4eee-af06-c4dd95a56d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:10.284770 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96725-bd64-4eee-af06-c4dd95a56d5e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.285224 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96725-bd64-4eee-af06-c4dd95a56d5e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.285629 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96725-bd64-4eee-af06-c4dd95a56d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.296383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:10.331992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332cd8e-5a38-4aa9-bc73-c79d4e2ac49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:10.333129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cd8e-5a38-4aa9-bc73-c79d4e2ac49c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.333510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cd8e-5a38-4aa9-bc73-c79d4e2ac49c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.333988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cd8e-5a38-4aa9-bc73-c79d4e2ac49c None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.334845 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332cd8e-5a38-4aa9-bc73-c79d4e2ac49c None admin] RBAC: Adding query filter params (name=member) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:10.335241 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332cd8e-5a38-4aa9-bc73-c79d4e2ac49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:10.339684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332cd8e-5a38-4aa9-bc73-c79d4e2ac49c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:10.357130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 176/344] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:10.357130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82880bc6-b410-41e4-b5c2-c3f99c9caada None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.357130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82880bc6-b410-41e4-b5c2-c3f99c9caada None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.357130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82880bc6-b410-41e4-b5c2-c3f99c9caada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.375855 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96725-bd64-4eee-af06-c4dd95a56d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:10.377857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96725-bd64-4eee-af06-c4dd95a56d5e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:10.386770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-82880bc6-b410-41e4-b5c2-c3f99c9caada None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:10.389052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-82880bc6-b410-41e4-b5c2-c3f99c9caada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:10.465504 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:10.496459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 169/345] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:10.498196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263da98-db6a-45d1-82d7-fecc363806ff None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.498681 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263da98-db6a-45d1-82d7-fecc363806ff None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.503876 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263da98-db6a-45d1-82d7-fecc363806ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.510947 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 177/346] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:10.512945 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82880bc6-b410-41e4-b5c2-c3f99c9caada None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:10.524399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-1263da98-db6a-45d1-82d7-fecc363806ff None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:10.526009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-1263da98-db6a-45d1-82d7-fecc363806ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:10.560891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:10.622626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 170/347] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:10.623847 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263da98-db6a-45d1-82d7-fecc363806ff None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:10.732006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82880bc6-b410-41e4-b5c2-c3f99c9caada None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:10.785124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263da98-db6a-45d1-82d7-fecc363806ff None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:10.809904 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:10.810662 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.811438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.811438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.826674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:10.827724 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.828485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.828964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.830485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:10.832282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:10.834376 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 171/348] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:10 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:10.847541 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:10.923656 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:10.964374 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:11.018334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:11.019752 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:11.118330 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfe0b3-8786-4489-b748-c6d7d7a27ca7 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:11.210274 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:11.211342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.211742 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.212209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.233310 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:11.236804 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:11.245122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 172/349] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:10 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:11.245122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:11.305615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 178/350] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:11.306773 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:11.377861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:11.381894 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1e268-083d-4b9c-a9a8-6e7b1dfe3670 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:11.413212 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:11.438789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:11.439434 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.439717 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.439987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.453171 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:11.458638 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a944a-f95e-4334-8d9e-9252a204ae0e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:11.459557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:11.460432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 173/351] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:11.462655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:11.508644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd167fe-4340-4eb6-8e2e-98af7ef64862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:11.509969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd167fe-4340-4eb6-8e2e-98af7ef64862 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.510491 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd167fe-4340-4eb6-8e2e-98af7ef64862 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.510831 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd167fe-4340-4eb6-8e2e-98af7ef64862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.511633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd167fe-4340-4eb6-8e2e-98af7ef64862 None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=c22fba313f3546509a08e2875c4a8c80) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:11.512016 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd167fe-4340-4eb6-8e2e-98af7ef64862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:11.513645 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd167fe-4340-4eb6-8e2e-98af7ef64862 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:11.522877 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 179/352] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:11 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:11.524972 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bcc76-c191-45c4-8890-c15103d4f7df None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.525418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bcc76-c191-45c4-8890-c15103d4f7df None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.525826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bcc76-c191-45c4-8890-c15103d4f7df None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.527913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 180/353] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:11.529060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bcc76-c191-45c4-8890-c15103d4f7df None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:11.602671 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65b4f1-4a0a-4e14-abc6-12b8656cdee1 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:11.658873 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:11.660001 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.660474 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.660984 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.681591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:11.687795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:11.688965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:11.689978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:11.691699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 174/354] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:11.693971 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:11.695761 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bcc76-c191-45c4-8890-c15103d4f7df None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:11.724223 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:11.748289 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e65079-c6e1-4c98-8598-e52b1aba90c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:11.748978 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e65079-c6e1-4c98-8598-e52b1aba90c2 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.749561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e65079-c6e1-4c98-8598-e52b1aba90c2 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.749945 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e65079-c6e1-4c98-8598-e52b1aba90c2 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.751170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e65079-c6e1-4c98-8598-e52b1aba90c2 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:11.752630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e65079-c6e1-4c98-8598-e52b1aba90c2 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:11.754591 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 181/355] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:11 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:11.755629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d1254-812f-4526-bbfb-6e2091dbf7b6 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.755903 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d1254-812f-4526-bbfb-6e2091dbf7b6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.756176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d1254-812f-4526-bbfb-6e2091dbf7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.769188 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:11.782821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-767d1254-812f-4526-bbfb-6e2091dbf7b6 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:11.784023 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-767d1254-812f-4526-bbfb-6e2091dbf7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:11.870023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a1cf0-579c-44b1-b7a7-fc4c98947555 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:11.887489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 182/356] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:11.892534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ffaca-3574-4339-a0f8-0ae59fdc8bcf None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.892534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ffaca-3574-4339-a0f8-0ae59fdc8bcf None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.892534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ffaca-3574-4339-a0f8-0ae59fdc8bcf None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.892534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 183/357] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:11.892534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ffaca-3574-4339-a0f8-0ae59fdc8bcf None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:11.923762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:11.924661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:11.924948 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:11.925292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:11.926650 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] RBAC: Adding query filter params (name=reader) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:11.926966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:11.928911 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:11.940383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 175/358] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:11.940771 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.020150 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ffaca-3574-4339-a0f8-0ae59fdc8bcf None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:12.059962 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eac65-750b-4614-984b-0cb27bdc429a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:12.060193 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feafe03-85c4-412a-b71d-4034fe856957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:12.060769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feafe03-85c4-412a-b71d-4034fe856957 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.061055 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feafe03-85c4-412a-b71d-4034fe856957 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.061354 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feafe03-85c4-412a-b71d-4034fe856957 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.061875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:12.062273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feafe03-85c4-412a-b71d-4034fe856957 None admin] RBAC: Adding query filter params (name=member) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:12.062638 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feafe03-85c4-412a-b71d-4034fe856957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:12.064067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feafe03-85c4-412a-b71d-4034fe856957 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:12.065799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:12.075136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 184/359] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:12.076439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99bc8b-116a-45c7-8b37-0ceec09db4c1 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.076722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99bc8b-116a-45c7-8b37-0ceec09db4c1 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.076997 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99bc8b-116a-45c7-8b37-0ceec09db4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.103078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:12.103794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.104077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.104378 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.106532 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:12.108154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:12.110234 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 176/360] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:11 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:12.111072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.116288 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-fb99bc8b-116a-45c7-8b37-0ceec09db4c1 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:12.119041 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-fb99bc8b-116a-45c7-8b37-0ceec09db4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:12.213625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 185/361] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:12.214551 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99bc8b-116a-45c7-8b37-0ceec09db4c1 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.265124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49346ff-dd47-46ae-8802-6bdacf8912ff None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:12.334220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:12.334870 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.335146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.335436 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] PATH_INFO: `/v3/users/3b03d6534c89469d9fe7f1aa79fa0172` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.337471 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=3b03d6534c89469d9fe7f1aa79fa0172)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:12.338940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:12.344969 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 177/362] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/users/3b03d6534c89469d9fe7f1aa79fa0172 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:12.345902 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.394674 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99bc8b-116a-45c7-8b37-0ceec09db4c1 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:12.417534 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:12.426251 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:12.438242 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:12.439193 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.439643 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.440083 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.513254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1e740-b9fd-4515-a463-86f08a1e5ed7 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:12.533357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:12.535137 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:12.563850 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:12.564960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.565443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.565851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.567012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=c22fba313f3546509a08e2875c4a8c80) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:12.567926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:12.571119 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:12.581621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 178/363] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:12.582805 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.711261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:12.721621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 186/364] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:12.723038 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.740284 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a1f9-d3cb-4f7b-b138-b4d7f261a377 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:12.760112 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:12.797151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:12.797960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.798482 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.798755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.799956 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] RBAC: Adding query filter params (role.id=59835fbc5570419389d43af639ca96b4, user.id=3b03d6534c89469d9fe7f1aa79fa0172, scope.system=all) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:12.800531 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:12.802265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:12.821308 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 179/365] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/role_assignments?user.id=3b03d6534c89469d9fe7f1aa79fa0172&scope.system=all&role.id=59835fbc5570419389d43af639ca96b4 => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:12.822227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.865179 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a51af1-7718-4538-b372-257dca3fa15f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:12.909056 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:12.910209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.910794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.911328 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.926596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:12.932397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:12.933614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:12.934432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:12.937221 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 187/366] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:12.938356 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.972166 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c43b3-5f6b-4606-98e5-4b37002fc5ce None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.039765 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.040891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.041400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.041990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.046795 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:13.057112 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:13.064675 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:13.066636 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3e3dc-80e6-4891-8439-3dae11b97517 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:13.072421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:13.073418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:13.074216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 180/367] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:13.074882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:13.111369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.112050 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.112395 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.112672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.114642 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:13.116599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:13.119924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 188/368] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:13.120848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:13.222654 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d353e-f299-4401-b693-109f3b303393 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.278755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.280025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.280461 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.280888 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.281620 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:13.281926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:13.283805 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:13.294824 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 181/369] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:13.295679 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:13.317067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61af3c-2db9-435a-a2bd-7d11d6279b74 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.363144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.363754 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.364034 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.364303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.364969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:13.366625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:13.368022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:13.382016 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 189/370] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:13.383399 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:13.388500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:13.415590 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:13.446862 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314119d7-b424-4aa1-b143-e6a2107ed26b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.527178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.528246 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.528746 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.529266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.530043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2d40-4ca3-44e3-a885-5b9f0f2429bf None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.533262 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:13.537295 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:13.539672 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 182/371] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:13 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:13.540744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:13.626359 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.627324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.627841 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.628344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.725142 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2628d14-9d78-46d2-831c-409b402844c3 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.731448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:13.733479 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:13.753384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:13.760096 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:13.769188 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.770194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.770622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.771046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.850984 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:13.851811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 190/372] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:13.852752 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:13.853060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:13.965338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239bfa-d533-4afd-84ca-3ac3a0e0dcdf None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.969545 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 183/373] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:13.970658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:13.984877 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:14.004416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:14.005230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.005617 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.006100 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.006815 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:14.007213 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:14.009289 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:14.009550 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:14.016695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 191/374] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:13 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:14.021690 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:14.099586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e86e12-4367-40d1-bd4b-c8ef6bec0db8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:14.151138 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:14.152200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.152660 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.153146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.158229 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:14.160075 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:14.162329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 184/375] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:13 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:14.179362 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:14.203752 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455816b8-3b50-4129-9934-4b950cadce58 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:14.261182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:14.262334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.262671 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.263006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] PATH_INFO: `/v3/projects/7cc9a30a2c0d456c80b6d663506d1794` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.264534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] RBAC: Authorizing `identity:get_project(project_id=7cc9a30a2c0d456c80b6d663506d1794)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:14.266470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:14.268865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 192/376] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:14 2022] GET /identity/v3/projects/7cc9a30a2c0d456c80b6d663506d1794 => generated 344 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:14.275935 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:14.341805 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:14.357887 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:14.366963 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2086d02-a131-4038-93ed-06f9c9bacbb1 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:14.394527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c3bf1-7772-4853-89b5-de398c39e74e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:14.420196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4fc25-c62b-4648-bd64-69cfc13ad9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:14.421599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fc25-c62b-4648-bd64-69cfc13ad9d9 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.422090 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fc25-c62b-4648-bd64-69cfc13ad9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.422570 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fc25-c62b-4648-bd64-69cfc13ad9d9 None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.424127 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4fc25-c62b-4648-bd64-69cfc13ad9d9 None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:14.425925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4fc25-c62b-4648-bd64-69cfc13ad9d9 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:14.428258 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 185/377] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:14 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:14.429844 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796297ea-2315-4ba7-8a56-05f08cec39e4 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.430325 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796297ea-2315-4ba7-8a56-05f08cec39e4 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.430790 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796297ea-2315-4ba7-8a56-05f08cec39e4 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.432493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 186/378] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:14.438012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4957d-5914-4e81-82ef-d51f8d4f3541 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.438558 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4957d-5914-4e81-82ef-d51f8d4f3541 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.439022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4957d-5914-4e81-82ef-d51f8d4f3541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.442905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:14.443561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.443839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.444191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] PATH_INFO: `/v3/groups/5f03715c199848e8acd27eb19e2a6293` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.458964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] RBAC: Authorizing `identity:get_group(group_id=5f03715c199848e8acd27eb19e2a6293)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:14.458964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:14.461283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 193/379] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:14 2022] GET /identity/v3/groups/5f03715c199848e8acd27eb19e2a6293 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:14.462879 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:14.467929 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b1f4957d-5914-4e81-82ef-d51f8d4f3541 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:14.468554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b1f4957d-5914-4e81-82ef-d51f8d4f3541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:14.596737 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 187/380] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:14.598527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4957d-5914-4e81-82ef-d51f8d4f3541 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:14.616923 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f52049-29df-44af-9915-4a4cdd20e604 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:14.657698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:14.667610 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:14.669424 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.670231 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.670737 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.673290 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:14.673869 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:14.676191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:14.684700 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 194/381] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:14 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:14.852402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:14.867304 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4957d-5914-4e81-82ef-d51f8d4f3541 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:14.946584 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:14.947221 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:14.947492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:14.947759 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:14.948505 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] RBAC: Adding query filter params (group.id=5f03715c199848e8acd27eb19e2a6293, role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=7cc9a30a2c0d456c80b6d663506d1794) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:14.948808 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:14.950332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:14.966732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 188/382] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:14 2022] GET /identity/v3/role_assignments?group.id=5f03715c199848e8acd27eb19e2a6293&scope.project.id=7cc9a30a2c0d456c80b6d663506d1794&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 260 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:15.040020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:15.205647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8c6-1f5f-4990-a777-d453191bd6a7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:15.248095 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:15.249089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.249585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.250138 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.265760 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:15.271627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:15.272802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:15.273862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:15.276139 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 195/383] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:39:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:15.282395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:15.428823 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5a11b-f68d-47f0-b663-ad09e42e5761 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:15.478246 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:15.478791 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.479060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.479329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.480018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:15.480315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:15.481734 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:15.493835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 189/384] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:15.500360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:15.565232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:15.663394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b728a-67f1-4ba9-bf8a-5396e41c971a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:15.715203 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7ea3-9ed8-4d18-857e-4440c4978606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:15.715846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7ea3-9ed8-4d18-857e-4440c4978606 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.716117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7ea3-9ed8-4d18-857e-4440c4978606 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.716386 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7ea3-9ed8-4d18-857e-4440c4978606 None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.721938 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7ea3-9ed8-4d18-857e-4440c4978606 None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:15.723423 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7ea3-9ed8-4d18-857e-4440c4978606 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:15.725296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 196/385] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:15 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:15.731252 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:15.775923 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:15.888416 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995258ea-27fc-4859-b4e9-418e2230c0bb None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:15.893557 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606df3a-4a35-4b1f-96d3-15c8e765a4df None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.893834 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606df3a-4a35-4b1f-96d3-15c8e765a4df None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.894105 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606df3a-4a35-4b1f-96d3-15c8e765a4df None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.895697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 197/386] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:15.917121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd3e4-623d-41ed-9ba7-ee5a4b07bdd6 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.917121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd3e4-623d-41ed-9ba7-ee5a4b07bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.917121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd3e4-623d-41ed-9ba7-ee5a4b07bdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.944734 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-80acd3e4-623d-41ed-9ba7-ee5a4b07bdd6 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:15.946012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-80acd3e4-623d-41ed-9ba7-ee5a4b07bdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:15.957199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:15.957907 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.958429 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.958851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.960100 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:15.961869 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:15.963519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 190/387] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:15 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:15.973235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:16.117820 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 198/388] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:16.130235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:16.148381 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a236-b8f9-41d3-8293-b2cb5b8ac6f0 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:16.197433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:16.198155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:16.198432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:16.198702 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/76db2368efc54ba8ad85cff0b72339ff` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:16.200944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] RBAC: Authorizing `identity:create_grant(project_id=c22fba313f3546509a08e2875c4a8c80, group_id=41b8d28f40a74e55801bcfd6a7f77b1a, role_id=76db2368efc54ba8ad85cff0b72339ff)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:16.202631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:16.230323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 191/389] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 22 20:39:15 2022] PUT /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/76db2368efc54ba8ad85cff0b72339ff => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:16.728977 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd3e4-623d-41ed-9ba7-ee5a4b07bdd6 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:16.772542 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:16.865118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd3e4-623d-41ed-9ba7-ee5a4b07bdd6 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:16.912398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:16.913069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:16.913364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:16.913629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:16.934030 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:16.939108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:16.940094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:16.941639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 199/390] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:16.946282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:17.074690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efcdbe-cd40-43d1-814b-dfb0a415882f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:17.127211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:17.128184 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.128652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.129206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.130086 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:17.130668 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:17.134118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:17.148500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 192/391] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:17.154347 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:17.294003 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:17.315924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0d33-4449-4246-abde-1a847008ebf2 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:17.365041 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a4a5-c9c3-497c-a548-f38f42cfd21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:17.365729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a4a5-c9c3-497c-a548-f38f42cfd21e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.366006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a4a5-c9c3-497c-a548-f38f42cfd21e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.366276 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a4a5-c9c3-497c-a548-f38f42cfd21e None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.367537 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422a4a5-c9c3-497c-a548-f38f42cfd21e None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:17.369047 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422a4a5-c9c3-497c-a548-f38f42cfd21e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:17.371002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 200/392] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:17 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:17.377867 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:17.395282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:17.510532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc340-aa3b-4887-9364-d9a9cacaa014 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.510856 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc340-aa3b-4887-9364-d9a9cacaa014 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.511075 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc340-aa3b-4887-9364-d9a9cacaa014 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.512593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 201/393] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:17.518383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf9085-61cf-461b-9dbe-7ebcca0732f6 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.518666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf9085-61cf-461b-9dbe-7ebcca0732f6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.518941 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf9085-61cf-461b-9dbe-7ebcca0732f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.537171 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd8c1-1591-49c7-a5f5-0a998843849d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:17.555676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-4bbf9085-61cf-461b-9dbe-7ebcca0732f6 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:17.557359 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-4bbf9085-61cf-461b-9dbe-7ebcca0732f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:17.613024 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:17.613759 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.614081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.614449 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.616982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:17.618502 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:17.620428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 193/394] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:17 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:17.627327 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:17.712640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 202/395] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:17.724644 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:17.743611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7213a-297f-42aa-919f-503f9f14097a None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.744157 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7213a-297f-42aa-919f-503f9f14097a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.744526 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7213a-297f-42aa-919f-503f9f14097a None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.746939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 203/396] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:17.752817 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd13b1-2749-407a-b1cf-7a89c2e94c9a None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.753140 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd13b1-2749-407a-b1cf-7a89c2e94c9a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.753507 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd13b1-2749-407a-b1cf-7a89c2e94c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.756494 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdba8d-d3ce-4b13-b2d8-2e17d19c8e45 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:17.795155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9fcd13b1-2749-407a-b1cf-7a89c2e94c9a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:17.797413 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9fcd13b1-2749-407a-b1cf-7a89c2e94c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:17.800330 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81355fd8-d105-4df3-a2e5-dda85f0dd0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:17.801007 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81355fd8-d105-4df3-a2e5-dda85f0dd0de None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:17.801306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81355fd8-d105-4df3-a2e5-dda85f0dd0de None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:17.801577 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81355fd8-d105-4df3-a2e5-dda85f0dd0de None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:17.804170 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81355fd8-d105-4df3-a2e5-dda85f0dd0de None admin] RBAC: Authorizing `identity:create_grant(project_id=c22fba313f3546509a08e2875c4a8c80, group_id=41b8d28f40a74e55801bcfd6a7f77b1a, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:17.805723 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81355fd8-d105-4df3-a2e5-dda85f0dd0de None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:17.831233 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 194/397] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 22 20:39:17 2022] PUT /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:17.923819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 204/398] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:18.103869 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032d75-e76a-4dfc-b1fa-572bfb815338 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:18.104392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032d75-e76a-4dfc-b1fa-572bfb815338 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:18.104392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032d75-e76a-4dfc-b1fa-572bfb815338 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:18.106122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 195/399] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:18.112020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b64a-7e5d-4998-9f0a-1b26dacc3523 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:18.112295 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b64a-7e5d-4998-9f0a-1b26dacc3523 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:18.112570 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b64a-7e5d-4998-9f0a-1b26dacc3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:18.134100 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-89f0b64a-7e5d-4998-9f0a-1b26dacc3523 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:18.135339 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-89f0b64a-7e5d-4998-9f0a-1b26dacc3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:18.161715 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:18.212975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032d75-e76a-4dfc-b1fa-572bfb815338 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:18.249232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 205/400] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:18.410978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032d75-e76a-4dfc-b1fa-572bfb815338 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:18.467272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0b64a-7e5d-4998-9f0a-1b26dacc3523 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:18.487743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:18.488987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:18.489445 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:18.489937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:18.521836 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:18.527592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:18.528500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:18.529301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:18.532219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:18.532769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 196/401] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:18.541588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:18.693987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0b64a-7e5d-4998-9f0a-1b26dacc3523 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:18.709445 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35766a-2032-4de8-ac85-6446e06baf2a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:18.740587 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:18.741265 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:18.741548 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:18.741814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:18.753000 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:18.753940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:18.754221 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:18.754371 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:18.755047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:18.755179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:18.755477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:18.757068 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:18.759902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:18.760771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:18.761592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:18.765311 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 206/402] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:18.766309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:18.769078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 197/403] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:18.769959 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:18.792099 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:18.858038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:18.904644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88ea25-5f09-4abf-a90c-fa80c8e8f1dc None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:18.905436 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1b80f-9075-4928-a056-451a70a47ab8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:18.945380 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:18.946317 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:18.946727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:18.947185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:18.949500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:18.950291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:18.950745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:18.951153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:18.952073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:18.952559 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:18.954269 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:18.959517 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:18.963825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 198/404] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:18.968530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:18.969623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:18.970627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:18.971300 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 207/405] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:39:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:18.971887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:18.972529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.050622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:19.089071 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240034-5252-4105-afea-c00b9283c4d8 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.100869 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649ca5-bd19-4eb7-bef8-51e244e32ebe None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.129739 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.131130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.131807 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.132236 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.134067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.135758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.137006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:19.138191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 208/406] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:18 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:19.139208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.156768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.157467 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.157823 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.158399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] PATH_INFO: `/v3/groups/5f03715c199848e8acd27eb19e2a6293` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.159427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] RBAC: Authorizing `identity:get_group(group_id=5f03715c199848e8acd27eb19e2a6293)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.161067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.162769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 199/407] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:18 2022] GET /identity/v3/groups/5f03715c199848e8acd27eb19e2a6293 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:19.168504 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.262586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fe94b-78ab-4bc7-a6a3-114bc1d29899 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.301803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7109af-5863-45a4-a3ca-d6aed329d4b7 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.301981 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.302545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.302820 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.303097 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.303761 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:19.304063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.305482 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.318463 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 209/408] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:19.318463 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.321264 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:19.349884 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044b390-08f9-4d19-9380-6fc62b9c6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.350548 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b390-08f9-4d19-9380-6fc62b9c6a9d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.350827 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b390-08f9-4d19-9380-6fc62b9c6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.351098 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b390-08f9-4d19-9380-6fc62b9c6a9d None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.352336 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044b390-08f9-4d19-9380-6fc62b9c6a9d None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.353830 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044b390-08f9-4d19-9380-6fc62b9c6a9d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.360592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 200/409] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:19 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:19.360592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae830-3c92-4ef2-b5f0-f5210dcb1a2b None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.360592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae830-3c92-4ef2-b5f0-f5210dcb1a2b None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.360592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae830-3c92-4ef2-b5f0-f5210dcb1a2b None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.363425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 201/410] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:19.364335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ae830-3c92-4ef2-b5f0-f5210dcb1a2b None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.435399 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83894-c3c5-4947-b4f6-3099aaa6e82a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.436926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:19.483620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.484513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.484789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.485059 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] PATH_INFO: `/v3/projects/7cc9a30a2c0d456c80b6d663506d1794` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.485180 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ae830-3c92-4ef2-b5f0-f5210dcb1a2b None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.486219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] RBAC: Authorizing `identity:get_project(project_id=7cc9a30a2c0d456c80b6d663506d1794)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.487706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.489516 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 210/411] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:19 2022] GET /identity/v3/projects/7cc9a30a2c0d456c80b6d663506d1794 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:19.490253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.526590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3f4f-7898-4d15-9023-ac4f8641ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.528320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3f4f-7898-4d15-9023-ac4f8641ef77 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.528803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3f4f-7898-4d15-9023-ac4f8641ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.529310 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3f4f-7898-4d15-9023-ac4f8641ef77 None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.530812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd3f4f-7898-4d15-9023-ac4f8641ef77 None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.532940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd3f4f-7898-4d15-9023-ac4f8641ef77 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.535518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 202/412] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:19 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:19.537581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b7a2-d4c4-452b-8f4e-97607a0865bc None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.538050 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b7a2-d4c4-452b-8f4e-97607a0865bc None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.538651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b7a2-d4c4-452b-8f4e-97607a0865bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.561919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:19.563684 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-34d5b7a2-d4c4-452b-8f4e-97607a0865bc None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:19.564974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-34d5b7a2-d4c4-452b-8f4e-97607a0865bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:19.596280 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12cc3-1d96-4c36-aa46-075c09423d8b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.632774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.633506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.633834 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.634087 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.635289 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 203/413] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:19.635910 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b7a2-d4c4-452b-8f4e-97607a0865bc None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.638500 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5, group_id=41b8d28f40a74e55801bcfd6a7f77b1a, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.641396 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.666777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 211/414] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 22 20:39:19 2022] PUT /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:19.666777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.752859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:19.838183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b7a2-d4c4-452b-8f4e-97607a0865bc None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.884446 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505bd27-610b-4f91-a965-4ffecc2e3ca7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:19.897270 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.897484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.897673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.898084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] PATH_INFO: `/v3/projects/7cc9a30a2c0d456c80b6d663506d1794/groups/5f03715c199848e8acd27eb19e2a6293/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.900595 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc9a30a2c0d456c80b6d663506d1794, group_id=5f03715c199848e8acd27eb19e2a6293, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.902211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.924492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 204/415] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 22 20:39:19 2022] PUT /identity/v3/projects/7cc9a30a2c0d456c80b6d663506d1794/groups/5f03715c199848e8acd27eb19e2a6293/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:19.939340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:19.952303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:19.953494 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:19.953969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:19.954430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:19.956005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:19.957958 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:19.960453 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 212/416] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:19 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:19.968774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:19.991998 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:20.161257 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f51d-c608-40ec-a04b-f8571110b2ca None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:20.199242 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:20.199884 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:20.200158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:20.200426 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:20.211541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:20.217086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:20.218541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:20.219344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 213/417] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:39:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:39:20.222082 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b351b23-7c12-4858-a5de-a5073d77adc4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:20.230144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:20.252443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:20.279767 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:20.280644 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:20.281124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:20.282071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/76db2368efc54ba8ad85cff0b72339ff` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:20.284155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5, group_id=41b8d28f40a74e55801bcfd6a7f77b1a, role_id=76db2368efc54ba8ad85cff0b72339ff)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:20.285781 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:20.302386 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 205/418] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 22 20:39:19 2022] PUT /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5/groups/41b8d28f40a74e55801bcfd6a7f77b1a/roles/76db2368efc54ba8ad85cff0b72339ff => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:20.312851 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:20.367680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183006-c0e4-4921-8462-473adac99dbf None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:20.408695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bab8d2-7bd3-4d62-a7f8-18292833ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:20.409695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab8d2-7bd3-4d62-a7f8-18292833ad51 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:20.410189 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab8d2-7bd3-4d62-a7f8-18292833ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:20.410651 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab8d2-7bd3-4d62-a7f8-18292833ad51 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:20.411607 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bab8d2-7bd3-4d62-a7f8-18292833ad51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:20.412121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bab8d2-7bd3-4d62-a7f8-18292833ad51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:20.413886 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bab8d2-7bd3-4d62-a7f8-18292833ad51 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:20.424568 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 214/419] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:20.433379 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:20.504058 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e1d74-2b48-4b73-81b3-586a1dae4479 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:20.504486 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e1d74-2b48-4b73-81b3-586a1dae4479 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:20.504627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e1d74-2b48-4b73-81b3-586a1dae4479 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:20.506725 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 215/420] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:20.521902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f04f0-00ba-4c6b-a265-634a0d24aada None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:20.522239 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f04f0-00ba-4c6b-a265-634a0d24aada None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:20.522448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f04f0-00ba-4c6b-a265-634a0d24aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:20.556633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-4e7f04f0-00ba-4c6b-a265-634a0d24aada None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:20.556633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-4e7f04f0-00ba-4c6b-a265-634a0d24aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:20.590957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df23668-1560-47e5-9d13-ce10033662d6 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:20.643122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:20.644347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:20.644814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:20.645457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:20.674241 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 216/421] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:20.717075 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:20.752590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:20.754073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:20.891470 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 206/422] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:20.897377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f04f0-00ba-4c6b-a265-634a0d24aada None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:20.971296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:21.042182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f04f0-00ba-4c6b-a265-634a0d24aada None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:21.092617 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:21.093162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:21.093436 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:21.093702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:21.094829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:21.096258 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:21.097901 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 217/423] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:20 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:21.103549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:21.174307 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:21.243969 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:21.284591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba636fd-5c08-43f0-8be5-b35506ae453d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:21.347309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b349a9-1d5c-4d1b-bc69-46b2c5132e93 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:21.359879 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:21.360521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:21.360793 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:21.361057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:21.363452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:21.364898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:21.367697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 207/424] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:21 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:21.374895 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:21.380995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:21.412679 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:21.413709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:21.414267 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:21.414530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:21.435826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:21.446425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:21.447392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:21.448184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:21.453279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 218/425] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:39:21.457795 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:21.568633 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1d5e9-8d02-4ac0-86a4-e0d503376537 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:21.638961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:21.639786 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:21.640139 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:21.640380 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:21.641216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=c22fba313f3546509a08e2875c4a8c80) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:21.641527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:21.643128 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:21.652704 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da576f-5fb1-498c-9a8f-6ea963948428 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:21.663754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 208/426] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:21 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 611 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:21.712711 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:21.713614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:21.714123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:21.714489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:21.715250 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] RBAC: Adding query filter params (name=member) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:21.715570 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:21.717756 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:21.728721 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 219/427] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:21.735330 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:21.755002 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:21.894378 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6279c5-52f8-47fa-819f-81ce5f55b9c6 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:21.935915 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a86305-d998-4828-98a5-c16d5a94128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:21.936963 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86305-d998-4828-98a5-c16d5a94128c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:21.937483 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86305-d998-4828-98a5-c16d5a94128c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:21.937967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86305-d998-4828-98a5-c16d5a94128c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.051379 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a86305-d998-4828-98a5-c16d5a94128c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:22.052958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a86305-d998-4828-98a5-c16d5a94128c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:22.068761 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:22.179522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 209/428] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:22.185233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:22.244962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:22.272411 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7940e5-5ab5-48cc-8dc5-52db27d8a041 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.272945 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7940e5-5ab5-48cc-8dc5-52db27d8a041 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.273122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7940e5-5ab5-48cc-8dc5-52db27d8a041 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.274777 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 210/429] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:22.280235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0e09-2b1e-41b6-8200-c202be117d38 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.280517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0e09-2b1e-41b6-8200-c202be117d38 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.280789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0e09-2b1e-41b6-8200-c202be117d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.310391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-55da0e09-2b1e-41b6-8200-c202be117d38 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:22.312427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-55da0e09-2b1e-41b6-8200-c202be117d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:22.315333 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a6b8-bea9-49a9-9228-2f64da9346da None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:22.357614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:22.358282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.358582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.358849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] PATH_INFO: `/v3/projects/c22fba313f3546509a08e2875c4a8c80` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.361876 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] RBAC: Authorizing `identity:get_project(project_id=c22fba313f3546509a08e2875c4a8c80)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:22.363458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:22.366415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 220/430] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:22 2022] GET /identity/v3/projects/c22fba313f3546509a08e2875c4a8c80 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:22.371865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:22.395968 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 211/431] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:22.489475 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6465ad-8473-4bb3-a0ce-f75cbca18805 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:22.499287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:22.527958 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:22.528597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.528878 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.529175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.530807 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:22.532271 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:22.534363 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 221/432] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:22 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:22.540969 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0e09-2b1e-41b6-8200-c202be117d38 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:22.590774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:22.658975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0e09-2b1e-41b6-8200-c202be117d38 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:22.700250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0212c9-f5f1-423a-9af6-d77e17bca1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:22.700876 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0212c9-f5f1-423a-9af6-d77e17bca1a0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.701174 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0212c9-f5f1-423a-9af6-d77e17bca1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.701442 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0212c9-f5f1-423a-9af6-d77e17bca1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.702704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0212c9-f5f1-423a-9af6-d77e17bca1a0 None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=c22fba313f3546509a08e2875c4a8c80) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:22.703012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0212c9-f5f1-423a-9af6-d77e17bca1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:22.704514 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0212c9-f5f1-423a-9af6-d77e17bca1a0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:22.713124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 212/433] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:22 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=c22fba313f3546509a08e2875c4a8c80&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:22.763592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:22.813397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae23c-adaa-468d-b6c4-3edb03ed654d None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.813727 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae23c-adaa-468d-b6c4-3edb03ed654d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.813979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae23c-adaa-468d-b6c4-3edb03ed654d None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.815322 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 213/434] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:22.821371 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e5e2a-afe3-47e0-b85a-79b906d6658f None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.821652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e5e2a-afe3-47e0-b85a-79b906d6658f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.821930 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e5e2a-afe3-47e0-b85a-79b906d6658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.846120 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-731e5e2a-afe3-47e0-b85a-79b906d6658f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:22.847960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-731e5e2a-afe3-47e0-b85a-79b906d6658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:22.896094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d2d4-2877-4eef-a7d1-d74d6c5d51cc None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:22.937225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 214/435] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:22.948980 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:22.949708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:22.949935 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:22.950207 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:22.963604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:22.966649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:22.967836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:22.968692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 222/436] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:22.976000 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e5e2a-afe3-47e0-b85a-79b906d6658f None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.014129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.091566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e5e2a-afe3-47e0-b85a-79b906d6658f None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:23.131484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907f8eb-6ae6-454c-8998-707b9022b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:23.132780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f8eb-6ae6-454c-8998-707b9022b547 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.133422 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f8eb-6ae6-454c-8998-707b9022b547 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.133992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f8eb-6ae6-454c-8998-707b9022b547 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.135060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907f8eb-6ae6-454c-8998-707b9022b547 None admin] RBAC: Adding query filter params (name=member) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:23.135845 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907f8eb-6ae6-454c-8998-707b9022b547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:23.137922 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907f8eb-6ae6-454c-8998-707b9022b547 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:23.152019 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 215/437] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:23.158647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.198239 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.255047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d7519-0586-4af5-a9ef-e062a218e688 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.255047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d7519-0586-4af5-a9ef-e062a218e688 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.255047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d7519-0586-4af5-a9ef-e062a218e688 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.255625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 216/438] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:23.263798 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210ce2-ff00-4330-b76d-628ec206a8c9 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.264331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210ce2-ff00-4330-b76d-628ec206a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.264953 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210ce2-ff00-4330-b76d-628ec206a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.288062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb73587-9900-465f-b818-ecfdf01b9979 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:23.292458 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-83210ce2-ff00-4330-b76d-628ec206a8c9 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:23.293715 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-83210ce2-ff00-4330-b76d-628ec206a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:23.332682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:23.333321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.333597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.333864 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.381388 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 217/439] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:23.382893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210ce2-ff00-4330-b76d-628ec206a8c9 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.421595 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.432835 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:23.434348 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:23.470716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.509892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210ce2-ff00-4330-b76d-628ec206a8c9 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:23.550913 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:23.551689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.551888 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.552095 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.554062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 223/440] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:23.559937 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.565562 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:23.570818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:23.572535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:23.574106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 218/441] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:23.584956 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.674413 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb587ba9-eec7-43a6-9da9-c00947add32f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:23.711061 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.711380 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:23.711913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.712183 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.712447 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.713616 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:23.715065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:23.716849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 224/442] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:23.721611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.725701 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.730489 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a17b-09ee-41e9-8dce-aae517b70742 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:23.772342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:23.772342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.772342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.772342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.772819 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:23.772819 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:23.772819 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:23.780747 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 219/443] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:23.785768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.835349 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b6a6-59d2-43b9-9ee1-2f8bb504f823 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:23.869686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:23.870333 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.870586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.870852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.881951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:23.887004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:23.887883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:39:23.888680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:23.889352 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c99e-4912-41a3-a7f3-ba4cf2a660e1 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:23.889439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 225/444] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:39:23.889439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.923830 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:23.924465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:23.924738 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:23.925008 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:23.926176 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:23.927625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:23.929297 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 220/445] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:23.930068 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:23.950239 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.955951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:23.994956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c2109-02f3-4bf7-bafc-706104595bbc None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.030907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.031506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.031783 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.032050 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.035194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180cc94-4b43-4a3f-8ab3-41b776d4feaf None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.069765 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.070373 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.070651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.070928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.071582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:24.071884 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.073332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.081657 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 221/446] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:24.082452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:24.103022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.104416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.162673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:24.168326 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:24.185549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd18b-a9a2-45e4-a87e-01d9b0f438fe None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.207470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 226/447] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:24.208305 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:24.224207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.224818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.225129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.225399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.226119 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=ecb9b0fc60ff48f4aec62bb80c281b54, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:24.226428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.227854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.236452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 222/448] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=ecb9b0fc60ff48f4aec62bb80c281b54 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:24.236452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:24.333021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73518551-3692-4e2f-86f8-42458058d8c3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.364170 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef334dd-7c4a-4da6-9fda-6d67a28c2b1c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.370577 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.371197 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.371982 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.372280 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.401439 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.402107 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.402382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.402651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] PATH_INFO: `/v3/projects/7cc9a30a2c0d456c80b6d663506d1794` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.403846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc9a30a2c0d456c80b6d663506d1794)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.405345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.411931 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 223/449] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/projects/7cc9a30a2c0d456c80b6d663506d1794 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:24.412589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:24.413213 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:24.430759 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:24.454929 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.456579 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.542426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313c331-f11e-4c17-ab72-d3f0d1fb5246 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.583625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 227/450] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:24.589926 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:24.592620 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.593569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.594056 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.595097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] PATH_INFO: `/v3/groups/5f03715c199848e8acd27eb19e2a6293` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.596315 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] RBAC: Authorizing `identity:get_group(group_id=5f03715c199848e8acd27eb19e2a6293)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.597801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.599569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 224/451] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/groups/5f03715c199848e8acd27eb19e2a6293 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:24.606306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:24.674606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:24.696379 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:24.715496 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73cfe7-73ff-46e9-a8bd-5088a2574e4f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.719267 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e40c-cc64-4f90-bc45-22b04d03e17c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.751415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.752065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.752351 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.752624 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] PATH_INFO: `/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.753793 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] RBAC: Authorizing `identity:get_project(project_id=eee9abe8ffc7441dbfbb80e4fdd52ac5)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.754872 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.755493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.755592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.755934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.756039 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.756744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] RBAC: Adding query filter params (group.id=5f03715c199848e8acd27eb19e2a6293, role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=7cc9a30a2c0d456c80b6d663506d1794) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:24.757045 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.757219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 228/452] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/projects/eee9abe8ffc7441dbfbb80e4fdd52ac5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:24.758986 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.763331 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:24.777542 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 225/453] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/role_assignments?group.id=5f03715c199848e8acd27eb19e2a6293&scope.project.id=7cc9a30a2c0d456c80b6d663506d1794&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:24.878826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858031bd-b392-45c3-8701-db6457b297c3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:24.914564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:24.920582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4b2a6-26e3-47e9-a648-07398591669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:24.921595 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b2a6-26e3-47e9-a648-07398591669f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:24.921870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b2a6-26e3-47e9-a648-07398591669f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:24.922113 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b2a6-26e3-47e9-a648-07398591669f None admin] PATH_INFO: `/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:24.923351 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4b2a6-26e3-47e9-a648-07398591669f None admin] RBAC: Authorizing `identity:get_group(group_id=41b8d28f40a74e55801bcfd6a7f77b1a)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:24.924920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4b2a6-26e3-47e9-a648-07398591669f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:24.926630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 229/454] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/groups/41b8d28f40a74e55801bcfd6a7f77b1a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:24.932954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:25.040847 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d070b-a30f-4674-9aa6-8e4e31fe6d1c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:25.078960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae7451-e44d-4550-b936-3ec40d7da855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:25.079599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae7451-e44d-4550-b936-3ec40d7da855 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:25.079874 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae7451-e44d-4550-b936-3ec40d7da855 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:25.080132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae7451-e44d-4550-b936-3ec40d7da855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:25.080852 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae7451-e44d-4550-b936-3ec40d7da855 None admin] RBAC: Adding query filter params (group.id=41b8d28f40a74e55801bcfd6a7f77b1a, role.id=76db2368efc54ba8ad85cff0b72339ff, scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:25.081160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae7451-e44d-4550-b936-3ec40d7da855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:25.082634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae7451-e44d-4550-b936-3ec40d7da855 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:25.088530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 226/455] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 22 20:39:24 2022] GET /identity/v3/role_assignments?group.id=41b8d28f40a74e55801bcfd6a7f77b1a&scope.project.id=eee9abe8ffc7441dbfbb80e4fdd52ac5&role.id=76db2368efc54ba8ad85cff0b72339ff => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:27.954504 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af502c-ddcd-485d-9f2e-bbfb4e77f6f4 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:27.955058 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af502c-ddcd-485d-9f2e-bbfb4e77f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:27.955058 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af502c-ddcd-485d-9f2e-bbfb4e77f6f4 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:27.956985 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 230/456] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:27.963256 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d6cfa-4188-4c5a-8aa5-f5a8d58fd836 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:27.964259 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d6cfa-4188-4c5a-8aa5-f5a8d58fd836 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:27.964741 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d6cfa-4188-4c5a-8aa5-f5a8d58fd836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:27.978883 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:27.985749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-6a3d6cfa-4188-4c5a-8aa5-f5a8d58fd836 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:27.986954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-6a3d6cfa-4188-4c5a-8aa5-f5a8d58fd836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:28.057143 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 227/457] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:28.122157 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875637-2a14-413c-ba3d-0ee10485a0ac None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.122773 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875637-2a14-413c-ba3d-0ee10485a0ac None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.123239 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875637-2a14-413c-ba3d-0ee10485a0ac None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.125277 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 231/458] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:28.130516 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbe14-c5ab-466b-8107-9af812e86c55 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.130792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbe14-c5ab-466b-8107-9af812e86c55 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.131065 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbe14-c5ab-466b-8107-9af812e86c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.136627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6669f-d703-4b5f-87ea-58a11885f20a None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.136779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6669f-d703-4b5f-87ea-58a11885f20a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.137006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6669f-d703-4b5f-87ea-58a11885f20a None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.138836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 232/459] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:28.145236 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3013a-e6a5-4904-9edf-f70cc9a502de None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.145587 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3013a-e6a5-4904-9edf-f70cc9a502de None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.145891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3013a-e6a5-4904-9edf-f70cc9a502de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.154100 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-33cfbe14-c5ab-466b-8107-9af812e86c55 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:28.155301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-33cfbe14-c5ab-466b-8107-9af812e86c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:28.165651 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-93f3013a-e6a5-4904-9edf-f70cc9a502de None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:28.167123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-93f3013a-e6a5-4904-9edf-f70cc9a502de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:28.242957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 228/461] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:28.249139 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 233/461] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:28.412691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfbe14-c5ab-466b-8107-9af812e86c55 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:28.485135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:28.500345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042a12-9d8e-411d-9934-b78f9b36bf1c None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.500537 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042a12-9d8e-411d-9934-b78f9b36bf1c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.500801 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042a12-9d8e-411d-9934-b78f9b36bf1c None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.502771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 234/462] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:28.509071 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67757fd0-a9ba-4e52-a880-6257da2b7f75 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.509408 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67757fd0-a9ba-4e52-a880-6257da2b7f75 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.509702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67757fd0-a9ba-4e52-a880-6257da2b7f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.529012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfbe14-c5ab-466b-8107-9af812e86c55 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:28.536802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-67757fd0-a9ba-4e52-a880-6257da2b7f75 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:28.538055 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-67757fd0-a9ba-4e52-a880-6257da2b7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:28.566101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:28.567146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.567611 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.568063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.579455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:28.581974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:28.599745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:28.601658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:28.602928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:28.602928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:28.602928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:28.602928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 229/463] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:28.602928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:28.622354 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 235/464] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:28.626083 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67757fd0-a9ba-4e52-a880-6257da2b7f75 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:28.717587 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:28.755301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147160f-ac0c-4373-86ce-0c450a31da67 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:28.773031 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67757fd0-a9ba-4e52-a880-6257da2b7f75 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:28.776947 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:28.799670 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:28.800319 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.800603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.800876 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.812854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:28.813604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:28.814245 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:28.814407 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.814873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.815335 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.827087 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:28.829431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:28.832954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:28.834101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:28.835242 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:28.835242 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:28.835242 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:28.836663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 230/465] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:28.837742 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:28.852785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:28.853920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:28.854823 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:28.854823 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:28.854823 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:28.854823 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 236/466] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:28.854823 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:28.960199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fd5b-eb23-4ed7-af29-a98691f19f55 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:28.971765 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467afee9-760c-4955-8aa5-3a7efdcf6913 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:28.985454 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:28.995580 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:28.996195 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:28.996475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:28.996748 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:28.997487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:28.997787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:28.999216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.008312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.008867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.009169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.009438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.010073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:29.010377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.011775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.018333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 231/467] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:29.018333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:29.034364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 237/468] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:29.034364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:29.051431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:29.133985 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aab27-4294-4c51-aab5-baa2a6de8866 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:29.152287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d742c-0828-4a61-ab0d-3b7097b19192 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:29.175053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.175658 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.175976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.176192 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.176829 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:29.177175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.178555 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.192210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.192994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.193331 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.193636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 232/469] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:29.193907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.198078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:29.206021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.207544 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:29.224048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:29.225337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:29.226319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:29.226319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:29.226319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:29.226319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 238/470] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:29.226319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:29.265322 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:29.312698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:29.323498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a22fc2-2ab0-496c-90f7-445cfbaf851e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:29.350051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f783b-11bb-4cb9-bcd4-8b86b24cbe82 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:29.358269 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.358877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.359148 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.359469 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.360133 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.361594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.383936 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 233/471] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:39:29 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:39:29.385016 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:29.392604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.393276 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.393555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.393830 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.394541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.396914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.437335 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 239/472] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:39:29 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:39:29.438643 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:29.532730 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9b96b-92dc-47a1-9fb5-8a94eef25ce7 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:29.582040 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:29.592557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.593368 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.593739 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.594189 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.594932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.597006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.613493 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f899d-b19c-4bfa-8aa6-9adc21be6bf6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:29.625340 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 234/473] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:39:29 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:39:29.660209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e2263-95dd-415e-b04b-c1158a7279cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.660878 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e2263-95dd-415e-b04b-c1158a7279cf None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.661212 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e2263-95dd-415e-b04b-c1158a7279cf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.661486 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e2263-95dd-415e-b04b-c1158a7279cf None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.662169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e2263-95dd-415e-b04b-c1158a7279cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:29.662485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e2263-95dd-415e-b04b-c1158a7279cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.663919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e2263-95dd-415e-b04b-c1158a7279cf None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.679156 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 240/474] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:29.685500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:29.689143 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:29.808200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927089df-7b1a-420a-b5ca-80b7ec409649 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:29.845675 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354e23-b240-4bcc-aea0-a00887b92134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:29.846371 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354e23-b240-4bcc-aea0-a00887b92134 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:29.846673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354e23-b240-4bcc-aea0-a00887b92134 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:29.846956 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354e23-b240-4bcc-aea0-a00887b92134 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:29.847665 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354e23-b240-4bcc-aea0-a00887b92134 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:29.849298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354e23-b240-4bcc-aea0-a00887b92134 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:29.871885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 235/475] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:39:29 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:39:31.787931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da2e1-5fa4-4c96-b85b-78ac8d613fe0 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:31.788969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da2e1-5fa4-4c96-b85b-78ac8d613fe0 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:31.789470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da2e1-5fa4-4c96-b85b-78ac8d613fe0 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:31.791282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 241/476] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:31.797403 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6bbfa-1f1d-456c-88b6-1adb1f5022b8 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:31.798299 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6bbfa-1f1d-456c-88b6-1adb1f5022b8 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:31.798767 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6bbfa-1f1d-456c-88b6-1adb1f5022b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:31.818142 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-47c6bbfa-1f1d-456c-88b6-1adb1f5022b8 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:31.819712 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-47c6bbfa-1f1d-456c-88b6-1adb1f5022b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:31.828543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe176-3ba5-4c98-9000-e34345e4c8a3 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:31.828899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe176-3ba5-4c98-9000-e34345e4c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:31.829202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe176-3ba5-4c98-9000-e34345e4c8a3 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:31.831024 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 242/477] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:31.837255 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c056ef-7418-4664-8931-be61374c1630 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:31.837554 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c056ef-7418-4664-8931-be61374c1630 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:31.837798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c056ef-7418-4664-8931-be61374c1630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:31.856546 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d4c056ef-7418-4664-8931-be61374c1630 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:31.857933 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d4c056ef-7418-4664-8931-be61374c1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:31.889563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:31.906187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 236/478] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:31.941220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 243/479] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:32.071892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f32f-11c8-4868-870e-2ec1e27fcc63 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.072224 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f32f-11c8-4868-870e-2ec1e27fcc63 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.072493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f32f-11c8-4868-870e-2ec1e27fcc63 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.074009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 237/480] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:32.079760 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26653-cffa-4ad0-851d-4afef9e5b6b0 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.080033 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26653-cffa-4ad0-851d-4afef9e5b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.080299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26653-cffa-4ad0-851d-4afef9e5b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.098607 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-89f26653-cffa-4ad0-851d-4afef9e5b6b0 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:32.099772 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-89f26653-cffa-4ad0-851d-4afef9e5b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:32.173530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:32.178904 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 244/481] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:32.210529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa0dbd-5ddc-410e-8968-5dabc2721854 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.210819 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa0dbd-5ddc-410e-8968-5dabc2721854 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.211075 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa0dbd-5ddc-410e-8968-5dabc2721854 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.212771 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 238/482] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:32.218122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828deb1-b961-4ce5-ae87-bf60f38ec1ad None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.219047 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828deb1-b961-4ce5-ae87-bf60f38ec1ad None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.219594 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828deb1-b961-4ce5-ae87-bf60f38ec1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.242099 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-f828deb1-b961-4ce5-ae87-bf60f38ec1ad None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:32.242099 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-f828deb1-b961-4ce5-ae87-bf60f38ec1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:32.242317 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa0dbd-5ddc-410e-8968-5dabc2721854 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.317683 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 245/483] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:32.318535 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828deb1-b961-4ce5-ae87-bf60f38ec1ad None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.370609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa0dbd-5ddc-410e-8968-5dabc2721854 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:32.407486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:32.408116 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.408383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.408646 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.419774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:32.424632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:32.425528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:32.426321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 239/484] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:32.431684 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.438469 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828deb1-b961-4ce5-ae87-bf60f38ec1ad None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:32.470671 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:32.479759 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:32.480811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.481220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.481607 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.496770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:32.503392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:32.504484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.505501 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:32.509118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 246/485] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:32.512894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.513960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:32.578172 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b96a-878e-49e8-8bb7-8239e155cfe7 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:32.612973 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:32.613889 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.614161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.614424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.615075 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:32.615364 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:32.616715 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:32.627515 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 240/486] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:32.628588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.642478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97904ed2-7b5f-49a3-8461-d4039131c8f5 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:32.689934 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:32.690565 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.690907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.691198 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.691870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] RBAC: Adding query filter params (name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:32.692187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:32.693582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:32.702306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 247/487] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:32.703178 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.740592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc6511-5fb4-4c7a-9bac-3c6026eb5ef4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:32.751390 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:32.768628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:32.778371 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:32.779045 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.779296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.779577 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.792588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:32.798006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:32.799925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:32.801157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 241/488] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:32.805003 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.830792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad6bb-8080-4031-a2bd-62974f31328d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:32.873354 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:32.874079 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.874352 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.874621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.886782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:32.888192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:32.904117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:32.905430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:32.906291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:32.906291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:32.906291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:32.906291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 248/489] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:32.906781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:32.919491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e796ba-6780-4717-ad63-3f6f6063f571 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:32.954624 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:32.955455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:32.955811 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:32.956081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:32.967614 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:32.972912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:32.974059 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:32.975011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:32.979206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 242/490] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:32.980136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.014370 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.022244 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62da21a-e720-4f1c-94b6-1c089a6169c5 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.024738 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.063528 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.064612 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.064883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.065176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.076257 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.077793 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.088447 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060564f-b6a5-4bb8-b804-b204af38d748 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:33.094755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:33.095868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:33.096723 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:33.096723 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:33.096723 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:33.096723 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 249/491] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:33.096954 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.125726 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.126361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.126612 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.126878 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.127538 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:33.127834 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.129257 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.151175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 243/492] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:33.151175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.217918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224595b4-73d4-4fb7-8162-90d26c7086aa None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.252218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.260441 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.261050 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.261369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.261606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.262255 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:33.262554 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.263931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.265611 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d4c3-90f5-4475-8544-119aad855795 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.277983 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 250/493] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:33.278865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.298977 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.302391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.303517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.303661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.303946 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.304819 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:33.305280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.306914 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.315792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 244/494] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:33.316651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.395966 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0b58-07c1-4a27-9166-c5267eb106f7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.433152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a0905-217f-4139-9bfa-bfb5a167608f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.438884 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.439520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.439788 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.440050 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.440692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:33.440996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.442415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.456144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 251/495] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:33.457282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.473586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.474235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.474507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.474778 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.488031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.490123 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:33.507427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:33.508998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:33.510022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:33.510022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:33.510022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:33.510022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 245/496] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:33.510022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.522592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.549436 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.575075 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c7081-0ed2-49f0-8421-83cf4af29ae9 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.611064 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.612093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.612340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.612617 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.621088 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.622576 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.631293 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7ae99-25ab-425b-9eaf-37ab0e79074e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:33.636102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:33.637063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 252/497] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:33.638439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.670062 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.670699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.670974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.671241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.684478 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.686661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:33.706512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:33.711155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:33.712685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:33.712685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:33.712685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:33.712685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 246/498] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:33.712685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.762234 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f146f-a905-46d2-9d9b-c760f4e82ee9 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.783799 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.799614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.800237 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.800513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.800779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.804453 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:33.810178 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.811953 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:33.824381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:33.825490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 253/499] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:33.826418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.830906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8cfc1-5103-436b-89d7-d10951c1e66c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:33.868740 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:33.869408 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:33.869762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:33.873528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:33.873528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:33.873528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:33.873528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:33.890957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 247/500] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:33.891983 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:33.961605 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9461-2f7e-4c73-98c6-9bd4eb199c4f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.000873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.001512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.001787 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.002053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.002794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:34.003093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.004568 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.006522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e200-c6e6-4536-9014-6c28078696d0 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.030691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.049595 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 254/501] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:34.050470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.057773 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.058389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.058663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.058937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.059585 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:34.059887 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.061382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.074715 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 248/502] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:34.075584 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.111338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.172802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e76062-5840-4371-b7f9-d3076ecfbd5a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.188807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30638e0-5eb4-4ed1-8cb2-cf80ba22dc8d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.215324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.215843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.216129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.216392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.217156 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:34.217478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.219154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.235462 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.236151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.236408 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.236684 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.243319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 255/503] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:34.243319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.245444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.246926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:34.261539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:34.262564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 249/504] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:34.263453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.310298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.361743 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd44cf1-3b19-4650-bb25-bf7305d2d379 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.379461 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.390292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3025a-415e-45c3-b881-d6b1c2ba90b1 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.412008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.412826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.413204 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.413538 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.431566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.432211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.432483 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.432763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.441345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.442809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:34.455266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:34.456254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 250/505] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:34.457966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.501155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.502684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.577525 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.582892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa234-c08c-47d4-aedb-2a18278a6936 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.613967 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 256/506] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:34.614862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.622638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.623275 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.623571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.623832 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.632459 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.709912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.711587 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.737826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38203d-f3f6-4160-a6f2-2a52b131d304 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.779448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.781524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.781524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.781524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.781524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:34.782330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.783542 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:34.803528 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 257/507] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:34.805882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.834971 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.840590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 251/508] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:34.842089 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:34.893012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:34.929790 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cea2f-f50c-4b97-b9ec-9db56ac44d49 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.961116 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b347d-93ee-456c-a8f9-1dcc4fba36f1 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:34.970106 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:34.970717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:34.970993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:34.971264 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:34.972002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:34.972311 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:34.973856 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.000303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 258/509] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:35.000303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.010991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.011623 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.011916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.012264 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.024636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.026151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:35.041840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:35.042818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:35.043659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:35.043659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:35.043659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:35.043659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 252/510] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:35.043659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.099123 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.119824 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904bb9c-899a-4ba4-8ed6-5631c75c126e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.150070 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.157502 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cf0a0-2f9f-4d56-a414-abafc8d5693c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.161114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.161786 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.162064 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.162331 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.196845 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.197519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.197794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.198062 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.210106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.211590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:35.227156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:35.228237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:35.229124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:35.229124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:35.229124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:35.229124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 253/511] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:35.229124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.241284 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.242794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.338699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542a3c-56ab-4876-920c-41fd9e062d8a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.340293 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.356606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 259/512] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:35.357621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.378649 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.380523 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.380523 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.380523 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.392021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.455106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.456578 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.472221 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a59682-6f6a-4055-8339-276f94e17a47 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.516311 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.516921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.517233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.517541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.518201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:35.518660 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.519894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.532527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 260/513] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:35.533454 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.585637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 254/514] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:35.585637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.585637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.658175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.676594 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063a5f-ab54-43bb-b986-05321e2fb4ac None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.721327 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.721992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.722363 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.722675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.723367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:35.723751 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.725480 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.738915 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 261/515] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:35.739827 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.750218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e877c0-25c5-4996-87b2-a28f9a086db5 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.793350 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.794023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.794300 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.794564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.806292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.807905 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:35.823743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:35.825431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:35.826787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:35.826787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:35.826787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:35.826787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 255/516] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:35.826787 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.871813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2fa4d-94a6-428c-ab52-d08d59d067f6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.891592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.913639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.914258 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.914447 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.914713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.923120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.924583 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:35.936710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:35.938167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:35.939009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:35.939445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 262/517] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:35.939919 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dde7e-f750-482c-be09-96437e2ae87b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:35.940093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:35.952538 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.982174 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:35.982790 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.983072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.983335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.994851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:35.996321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:36.011809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:36.012837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:36.013716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:36.013716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:36.013716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:36.013716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 256/518] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:36.013948 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.052216 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8c0df-b200-42ad-85fa-19fb46494f64 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.087653 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.088281 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.088550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.088816 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.096256 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.097755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:36.109691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:36.110808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:36.111699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 263/519] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:36.112168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.128531 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7f591-a3c8-430c-b995-1154f1cd5c0a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.137147 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.168187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.168690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.168966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.169221 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.169851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:36.170143 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.171540 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.186025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 257/520] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:36.186979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.203945 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.242056 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a22f-bb75-4157-a401-1ee47f53c36f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.280530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.281287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.281564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.281833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.282563 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:36.282865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.284343 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.303173 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 264/521] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:36.303959 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.318331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a59db-49c3-4ecf-933d-50b065d25613 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.355678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.356304 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.356697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.357021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.357710 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:36.358012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.360746 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.376127 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 258/522] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:36.376969 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.410767 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.432525 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ed00-28dc-4df6-9dde-b64d6b3b91c3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.466420 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.477254 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.478043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.478375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.478693 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.479497 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:36.479888 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.482103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.490934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3200de-841a-4912-8a01-65dacd789834 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.502087 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 265/523] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:36.502964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.533620 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.534278 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.534560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.534835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.542237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.543718 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:36.559209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:36.560333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:36.561206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 259/524] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:36.562628 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.633611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34eb8-292b-4d44-adf0-3b54299601fa None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.664351 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.680042 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.680667 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.680941 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.681239 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.681980 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=2e0c0dc1360a4dce928cbc27eab76ae1) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:36.682290 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.683852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.690229 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 266/525] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/role_assignments?user.id=2e0c0dc1360a4dce928cbc27eab76ae1&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:36.691065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.694623 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463e54c-784c-4d5a-aca2-3c907af5a39b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.748044 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.748809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.749135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.749421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.752492 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.761721 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.762733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:36.777686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:36.778749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:36.779651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:36.784062 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 260/526] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:36.785055 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.817774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529933-4589-4933-a74a-a2ed4b76afa4 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.873882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.874514 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.874870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.875137 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.875875 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=26fd52c94dc342eea817105f34e48190) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:36.876176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.877695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.885395 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 267/527] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/role_assignments?user.id=26fd52c94dc342eea817105f34e48190&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:36.886251 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.922721 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ec3b-19a0-49b4-ba4d-e9aba842191c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.970825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.971864 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.972363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.972774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.973693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:36.974185 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.976160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.999039 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 261/528] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:37.006586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:37.018473 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:37.041177 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b58fc8-bb39-4483-8bdd-4695d1284b20 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:37.069439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:37.091432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:37.092786 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:37.093172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:37.094329 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:37.095510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:37.095510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:37.097134 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:37.112420 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 268/529] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:37.118669 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:37.152685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf8d07-4c53-451b-b395-dcb1f93b58bf None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:37.200208 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2650-daab-4d96-94e2-74caf6bb3c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:37.201122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2650-daab-4d96-94e2-74caf6bb3c31 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:37.201443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2650-daab-4d96-94e2-74caf6bb3c31 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:37.201718 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2650-daab-4d96-94e2-74caf6bb3c31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:37.202454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2650-daab-4d96-94e2-74caf6bb3c31 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=68490ffb61b54cc78d3104049f0e03ae) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:37.202838 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2650-daab-4d96-94e2-74caf6bb3c31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:37.205766 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2650-daab-4d96-94e2-74caf6bb3c31 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:37.217196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 262/530] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:37 2022] GET /identity/v3/role_assignments?user.id=68490ffb61b54cc78d3104049f0e03ae&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:37.269147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03917b-c60e-4c96-b408-5bdc99db326b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:37.313326 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f320-059b-4362-b579-f23eff99fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:37.314011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f320-059b-4362-b579-f23eff99fbbf None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:37.314291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f320-059b-4362-b579-f23eff99fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:37.314558 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f320-059b-4362-b579-f23eff99fbbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:37.315314 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f320-059b-4362-b579-f23eff99fbbf None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=f344891bb32f4d86ab3c2536c3a4ae68) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:37.315618 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f320-059b-4362-b579-f23eff99fbbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:37.317142 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f320-059b-4362-b579-f23eff99fbbf None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:37.324070 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 269/531] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:37 2022] GET /identity/v3/role_assignments?user.id=f344891bb32f4d86ab3c2536c3a4ae68&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:39.222853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82aff-76dd-47d4-b984-4669b209b35b None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.223976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82aff-76dd-47d4-b984-4669b209b35b None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.224461 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82aff-76dd-47d4-b984-4669b209b35b None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.226585 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 263/532] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:39.233022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab354b8-3592-4cfb-ad89-e24d117dcd7a None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.234222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab354b8-3592-4cfb-ad89-e24d117dcd7a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.234914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab354b8-3592-4cfb-ad89-e24d117dcd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.259841 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-7ab354b8-3592-4cfb-ad89-e24d117dcd7a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:39.261450 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-7ab354b8-3592-4cfb-ad89-e24d117dcd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:39.303616 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:39.350980 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 270/533] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:39.396100 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556a1e4-96d9-44da-a4eb-bfebfe34bffe None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.397045 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556a1e4-96d9-44da-a4eb-bfebfe34bffe None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.397800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556a1e4-96d9-44da-a4eb-bfebfe34bffe None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.400481 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 264/534] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:39.406783 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cdca5-b606-4f47-8866-c32296d2fe9c None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.406783 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cdca5-b606-4f47-8866-c32296d2fe9c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.407164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cdca5-b606-4f47-8866-c32296d2fe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.427694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-f06cdca5-b606-4f47-8866-c32296d2fe9c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:39.429046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-f06cdca5-b606-4f47-8866-c32296d2fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:39.528460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 271/535] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:39.553699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eceab0-13c5-4286-9a9c-a65d533bf317 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.553958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eceab0-13c5-4286-9a9c-a65d533bf317 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.554240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eceab0-13c5-4286-9a9c-a65d533bf317 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.555946 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 265/536] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:39.561747 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1b65-909d-47ab-b2f7-4f3b15def569 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.562127 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1b65-909d-47ab-b2f7-4f3b15def569 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.562416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1b65-909d-47ab-b2f7-4f3b15def569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.582529 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-a95d1b65-909d-47ab-b2f7-4f3b15def569 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:39.583734 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-a95d1b65-909d-47ab-b2f7-4f3b15def569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:39.677164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 272/537] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:39.786111 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721a1d-7edb-4cb6-bcfa-cc1ebbd6c434 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.786363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721a1d-7edb-4cb6-bcfa-cc1ebbd6c434 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.786689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721a1d-7edb-4cb6-bcfa-cc1ebbd6c434 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.788180 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 266/538] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:39.793810 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67777b8-a7c0-4c93-b9fe-2524e17f6293 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.794166 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67777b8-a7c0-4c93-b9fe-2524e17f6293 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.794419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67777b8-a7c0-4c93-b9fe-2524e17f6293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.814450 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d67777b8-a7c0-4c93-b9fe-2524e17f6293 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:39.815644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d67777b8-a7c0-4c93-b9fe-2524e17f6293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:39.839956 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87721a1d-7edb-4cb6-bcfa-cc1ebbd6c434 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:39.846080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:39.922146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:39.933926 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 273/539] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:39.935201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67777b8-a7c0-4c93-b9fe-2524e17f6293 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:39.971375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87721a1d-7edb-4cb6-bcfa-cc1ebbd6c434 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.017249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.018405 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.019036 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.019543 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.035076 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:40.039909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:40.041673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:40.042493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 267/540] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:40.043184 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.072539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67777b8-a7c0-4c93-b9fe-2524e17f6293 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.115562 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.116508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.116937 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.117373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.132779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:40.137508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:40.139044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 274/541] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:40.140621 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.175986 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:40.202340 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ba9-b739-415e-8b93-1ea49292281a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.248858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:40.267261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.267900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.268173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.268749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.282183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:40.287451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:40.288389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:40.289216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 268/542] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:40.290005 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.297377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2c6a5-cd64-423b-816f-4dbe21500542 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.352336 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.353240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.353582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.353929 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.354857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:40.355213 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:40.356869 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:40.368144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 275/543] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:40.369021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.419707 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384f3d-3aac-4bbf-a9d1-a64e08cfa7c1 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.473773 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.474389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.474663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.474928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.475602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:40.475898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:40.477351 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:40.481471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:40.486789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 269/544] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:40.488032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.511527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36147737-bb74-499c-acaf-a0845fbf02b6 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.556334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.556977 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.557362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.557659 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.560974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:40.574818 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:40.581299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:40.583020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 276/545] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:40.584372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.629006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d203f4-ccf3-4ea8-9e7a-979ea2038aeb None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.676825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210190a7-97da-4098-a181-70213fa09088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.677586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210190a7-97da-4098-a181-70213fa09088 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.677980 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210190a7-97da-4098-a181-70213fa09088 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.678393 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210190a7-97da-4098-a181-70213fa09088 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.679167 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210190a7-97da-4098-a181-70213fa09088 None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:40.679537 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210190a7-97da-4098-a181-70213fa09088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:40.681320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210190a7-97da-4098-a181-70213fa09088 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:40.693178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 270/546] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:40.694552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210190a7-97da-4098-a181-70213fa09088 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.720069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a974b36-d133-46eb-95db-52c11e5cef35 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.760772 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.761441 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.761717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.761987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.774949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:40.776819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:40.779199 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:40.794360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:40.806550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:40.808249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:40.808249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:40.808249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:40.808249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 277/547] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:40.808249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.839450 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210190a7-97da-4098-a181-70213fa09088 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.864170 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:40.888803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.889492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.889764 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.890047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.902067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:40.903899 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:40.922031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:40.931813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:40.933519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:40.933519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:40.933519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:40.933519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 271/548] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:40.933519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:40.940332 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdee437-cfca-4423-b7b8-921664dcfb7f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:40.983047 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:40.983666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:40.983964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:40.984284 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:40.984980 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] RBAC: Adding query filter params (name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:40.985317 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:40.986713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:40.995452 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 278/549] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:40.996314 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.046983 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b2a10-b7d5-4264-9e6c-e5eac580424c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.062789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.106743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.107783 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.108275 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.108776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.110292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705997-9c40-470e-82e5-a7461328de0e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.121701 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.123165 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:41.138279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:41.139616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:41.140693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:41.140693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:41.140693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:41.140693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 272/550] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:41.140693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.158679 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.159292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.159583 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.159837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.160488 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:41.160785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.162213 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.164200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.178467 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 279/551] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:41.179267 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.261485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796c435-eeaf-4661-8689-a41812341598 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.300148 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.300756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.301028 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.301361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.301999 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:41.302294 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.303673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.305144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237ca15-2a49-4dc7-9cb5-6ffe9032b233 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.317385 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 273/552] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:41.318166 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.328500 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.353729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.354439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.354708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.355007 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.367257 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.368728 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:41.384709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:41.386720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:41.388398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:41.388398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:41.388398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:41.388398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 280/553] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:41.388398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.416977 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.443893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a97476-7d82-4de8-8a61-c6a947b20a49 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.483311 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.484177 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.484627 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.484901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.485599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:41.485898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.487278 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.500731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 274/554] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:41.501629 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.539758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859cd0-d6ad-4c18-af21-b9d9f4fc2c16 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.579689 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.580416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.580768 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.581041 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.590089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.591597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:41.604828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:41.605894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:41.606799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 281/555] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:41.607432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.631385 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb1c1-93b7-4b01-90c4-831e849e02ae None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.644162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.680014 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.680654 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.680933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.681234 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.690448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.691921 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.694205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:41.706530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:41.708314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 275/556] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:41.709693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.743687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fbea0-9846-45be-bc26-f4c97e41fd53 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.797866 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.798571 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.799020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.799490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.800628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:41.801142 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.803102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.821401 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 282/557] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:41.822409 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.851975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97d28e-9df1-44e0-8994-4ebd845d0e70 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.893925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.894570 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.894841 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.895110 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] PATH_INFO: `/v3/users/glance` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.904367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:41.906622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:41.918549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:41.920498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:39:41.922232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:41.924777 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 276/558] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:41.925641 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.940766 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.957519 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f720789-f510-47b2-8747-f1e70b23b7ed None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.002137 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.003114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.003605 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.004126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.005461 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:42.005999 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.009308 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.011103 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:42.033445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 283/559] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:42.034345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.066615 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a3e2-7d9a-4119-a35c-5897f9274645 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.103754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.104297 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.104573 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.104841 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.105634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:42.105945 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.107475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.150263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 277/560] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:42.151347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.177548 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae774b9c-339b-4323-a70b-08168e3edf3d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.222494 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.223141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.223414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.223676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.232712 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.234785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:42.247837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:42.248833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 284/561] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:42.250592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.263509 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:42.274981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f0f7a-2f1c-4362-b470-79dc97cb7415 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.298492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:42.318892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.319507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.319778 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.320044 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.320775 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:42.321076 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.322596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.342049 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 278/562] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:42.342749 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.406493 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0533763-48bf-474b-9556-9d580837d725 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.447321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.448297 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.448724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.449177 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.466415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.469001 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.475511 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760fa83-2aca-4678-83a8-4cd874b42b39 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:42.486601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:42.492769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:42.494095 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:42.494095 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:42.494095 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:42.494095 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 285/563] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:42.494095 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.528901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.529925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.530375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.531012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.548055 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.550686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:42.571754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:42.573705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:42.575424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:42.575424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:42.575424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:42.575424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 279/564] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:42.575424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.577259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:42.624931 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:42.633245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295bf61-6e73-45bc-b9e1-145018a4d28b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.679932 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.680470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.680749 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.681028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.681819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:42.682129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.683653 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.703675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 286/565] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:42.704938 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.747219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff476056-7235-4ef0-ba22-a01cc880ac16 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.799146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.799813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.800092 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.800361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.813318 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.814891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:42.830602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:42.832446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:42.834109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:42.834109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:42.834109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:42.834109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 280/566] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:42.834109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.842514 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252076-a215-4161-ac7d-5d22024f05fb None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:42.869595 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:42.893187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:42.893819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:42.894102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:42.894400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:42.895102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:42.895444 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.896863 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.909441 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 287/567] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:42.910321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:42.946367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:42.973897 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961a924-3efe-47f1-ae3a-2dc027377a90 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.017221 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.018077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.018569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.019050 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.020194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:43.020727 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.023435 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.028362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2399-a71d-466c-98a8-98a692ebca97 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.051268 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 281/568] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:43.051268 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.067146 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.067826 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.068101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.068491 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.080717 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.082376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:43.097858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:43.099073 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:43.100168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:43.100168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:43.100168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:43.100168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 288/569] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:43.101384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.133937 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:43.214628 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08d264-9d72-4828-9a7b-4b70e87429f5 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.215845 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d5047-975e-43ce-bc72-ed5a601573ad None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.259678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.260284 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.260557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.260815 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.261499 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:43.261796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.263168 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.263583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.264108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.264520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.265004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.271958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:43.274387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.276271 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.284082 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 282/570] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:43.284082 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:43.293844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:43.295745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 289/571] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:43.298604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.411123 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f28bf8-96e3-456b-8542-8a3e9c80b190 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.425165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:43.443413 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460cb66-44dd-4239-a819-1f24c2ead6d0 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.453464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.454433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.454735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.455007 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.463979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.465685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:43.480070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:43.481057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:43.482204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 283/572] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:43.483155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.489696 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.490733 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.491223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.491690 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.492829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:43.493393 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.495948 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.517762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 290/573] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:43.518667 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.551655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:43.601487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd97aef-c7ce-47e7-8adc-c8699986e6f4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.639972 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.640744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.641292 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.641402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.651010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.652499 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:43.665877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:43.667043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 284/574] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:43.668329 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.675330 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4dee5-fdb2-475c-966e-a221c4e519aa None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.715974 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.716512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.716779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.717044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.717812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:43.718284 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.719867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.732834 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 291/575] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:43.733364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.747200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:43.804696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001b4c-0ef4-49d3-973a-6e7344040aaa None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.824908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:43.848254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.848874 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.849187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.849461 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.850165 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:43.850475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.850801 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812261-54cc-48ab-b26f-c873f85b76ff None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:43.851949 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.865034 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 285/576] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:43.865958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.895181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:43.895973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:43.896306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:43.896702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:43.905261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:43.907502 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:43.919839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:43.927727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 292/577] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:43.928850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:43.977084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3f10a-5099-4648-a16c-d4f501e33ef5 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:44.016570 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:44.017081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.017392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.017656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.018462 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:44.018802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:44.020228 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:44.021610 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:44.033126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 286/578] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:44.034231 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:44.067083 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd23fc-2fb6-4a56-b7bd-df0bda386fed None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:44.083475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:44.107697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:44.108382 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.108942 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.109170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] PATH_INFO: `/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/2e0c0dc1360a4dce928cbc27eab76ae1/roles/5f672af6c905476c8fda8af9d08d714c` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.126370 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] RBAC: Authorizing `identity:create_grant(project_id=b23a3011ea504944be8e0d8f3394d7df, user_id=2e0c0dc1360a4dce928cbc27eab76ae1, role_id=5f672af6c905476c8fda8af9d08d714c)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:44.127843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:44.142248 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 293/579] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:39:43 2022] PUT /identity/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/2e0c0dc1360a4dce928cbc27eab76ae1/roles/5f672af6c905476c8fda8af9d08d714c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:44.142869 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:44.152759 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64d36f-61e2-418f-891b-179eb03aa52f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:44.203656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:44.204337 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.204610 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.204877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] PATH_INFO: `/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/26fd52c94dc342eea817105f34e48190/roles/5f672af6c905476c8fda8af9d08d714c` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.222181 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23a3011ea504944be8e0d8f3394d7df, user_id=26fd52c94dc342eea817105f34e48190, role_id=5f672af6c905476c8fda8af9d08d714c)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:44.223705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:44.253444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 287/580] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:39:44 2022] PUT /identity/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/26fd52c94dc342eea817105f34e48190/roles/5f672af6c905476c8fda8af9d08d714c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:44.253444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:44.328518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed541744-17a7-4d46-9acb-b7dffd9cda0e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:44.351919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:44.379233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:44.380992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.381660 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.382654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.383921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:44.384666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:44.387172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:44.392695 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:44.407018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e19ed3-9ad2-475c-9c7b-583eef856672 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:44.411606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 294/581] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:44.418656 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:44.482530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d091a-d535-4fe5-8334-c49e68a912da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:44.483812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d091a-d535-4fe5-8334-c49e68a912da None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.484317 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d091a-d535-4fe5-8334-c49e68a912da None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.484820 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d091a-d535-4fe5-8334-c49e68a912da None admin] PATH_INFO: `/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/68490ffb61b54cc78d3104049f0e03ae/roles/5f672af6c905476c8fda8af9d08d714c` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.517032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d091a-d535-4fe5-8334-c49e68a912da None admin] RBAC: Authorizing `identity:create_grant(project_id=b23a3011ea504944be8e0d8f3394d7df, user_id=68490ffb61b54cc78d3104049f0e03ae, role_id=5f672af6c905476c8fda8af9d08d714c)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:44.519813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d091a-d535-4fe5-8334-c49e68a912da None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:44.545949 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 288/582] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:39:44 2022] PUT /identity/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/68490ffb61b54cc78d3104049f0e03ae/roles/5f672af6c905476c8fda8af9d08d714c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:44.585360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb14e-88e2-446c-af75-9574d42147fd None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:44.629808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bc40a-a433-47ad-8323-91fbd8f22d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:44.630502 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc40a-a433-47ad-8323-91fbd8f22d25 None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.630781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc40a-a433-47ad-8323-91fbd8f22d25 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.631064 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc40a-a433-47ad-8323-91fbd8f22d25 None admin] PATH_INFO: `/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/f344891bb32f4d86ab3c2536c3a4ae68/roles/5f672af6c905476c8fda8af9d08d714c` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.650636 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bc40a-a433-47ad-8323-91fbd8f22d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23a3011ea504944be8e0d8f3394d7df, user_id=f344891bb32f4d86ab3c2536c3a4ae68, role_id=5f672af6c905476c8fda8af9d08d714c)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:44.652271 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bc40a-a433-47ad-8323-91fbd8f22d25 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:44.669892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 295/583] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:39:44 2022] PUT /identity/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/f344891bb32f4d86ab3c2536c3a4ae68/roles/5f672af6c905476c8fda8af9d08d714c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:39:46.668745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f92f-5955-4976-8f74-1b7c7cfeb282 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:46.669317 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f92f-5955-4976-8f74-1b7c7cfeb282 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:46.669317 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f92f-5955-4976-8f74-1b7c7cfeb282 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:46.671392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 289/584] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:46.678110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662a66-a65e-4649-9413-42bf40fae4cb None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:46.678664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662a66-a65e-4649-9413-42bf40fae4cb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:46.678884 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662a66-a65e-4649-9413-42bf40fae4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:46.705280 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-a8662a66-a65e-4649-9413-42bf40fae4cb None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:46.707273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-a8662a66-a65e-4649-9413-42bf40fae4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:46.754914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:46.819807 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 296/585] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:46.954110 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735098-c467-4b9c-9d92-381ca65294c3 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:46.954966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735098-c467-4b9c-9d92-381ca65294c3 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:46.955579 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735098-c467-4b9c-9d92-381ca65294c3 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:46.958190 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 290/586] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:46.966592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826183e-05e9-49f8-a18c-3a1d214db306 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:46.967500 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826183e-05e9-49f8-a18c-3a1d214db306 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:46.968335 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826183e-05e9-49f8-a18c-3a1d214db306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:46.996633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-c826183e-05e9-49f8-a18c-3a1d214db306 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:46.998414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-c826183e-05e9-49f8-a18c-3a1d214db306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:47.081326 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 297/587] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:47.180724 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b735098-c467-4b9c-9d92-381ca65294c3 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.259691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0979a-8f20-4c68-aa47-0075c4b0fc10 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.260019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0979a-8f20-4c68-aa47-0075c4b0fc10 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.260239 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0979a-8f20-4c68-aa47-0075c4b0fc10 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.265411 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 298/588] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:47.269037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c027f-d830-40ac-8461-bd93c4763079 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.269331 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c027f-d830-40ac-8461-bd93c4763079 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.269565 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c027f-d830-40ac-8461-bd93c4763079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.290635 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9a9c027f-d830-40ac-8461-bd93c4763079 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:47.292069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9a9c027f-d830-40ac-8461-bd93c4763079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:47.298603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b735098-c467-4b9c-9d92-381ca65294c3 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:47.347104 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:47.348256 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.349294 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.349816 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.360634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:47.371140 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:47.380258 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 299/589] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:47.381291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:47.382924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:47.383755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:47.390223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed025-0163-4041-9f8b-892cc7ea3133 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.390223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed025-0163-4041-9f8b-892cc7ea3133 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.390223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed025-0163-4041-9f8b-892cc7ea3133 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.390223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 300/590] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:47.390596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 291/591] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:47.390694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470176ed-9ea9-49d3-87c7-6a53475c855e None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.390694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470176ed-9ea9-49d3-87c7-6a53475c855e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.390694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470176ed-9ea9-49d3-87c7-6a53475c855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.394149 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.412819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-470176ed-9ea9-49d3-87c7-6a53475c855e None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:47.418383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-470176ed-9ea9-49d3-87c7-6a53475c855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:47.432540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:47.502132 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 301/592] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:47.502920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470176ed-9ea9-49d3-87c7-6a53475c855e None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.549571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b42be-9c20-47c6-a8f9-3fc791c7966a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:47.588205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:47.588861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.589287 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.589555 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.590314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:47.590721 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:47.592035 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:47.601699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 292/593] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:47.607175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.630230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470176ed-9ea9-49d3-87c7-6a53475c855e None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:47.676661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:47.682375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:47.683702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.684186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.684659 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.699915 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:47.706020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:47.706995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:47.707836 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:47.712648 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 302/594] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:47.714622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.732430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:47.734985 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252c01-8ff4-4870-a639-08850f8b2859 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:47.775629 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:47.777294 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.777294 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.777495 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.791759 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:47.793521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:47.813518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:47.814626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:47.815529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:47.815529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:47.815529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:47.815529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 293/595] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:39:47.815529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.855115 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845355-d1f8-453e-95f7-eaa3a6f39563 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:47.894926 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:47.895404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.895673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.895939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.896617 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] RBAC: Adding query filter params (name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:47.896926 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:47.898373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:47.907782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 303/596] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:47.908632 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.934103 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aca1c2-55c9-403d-8f83-587e1d5d62a6 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:47.949597 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:47.970990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9896-1942-4d70-9940-35b24929191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:47.971625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9896-1942-4d70-9940-35b24929191e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.971901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9896-1942-4d70-9940-35b24929191e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.972254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9896-1942-4d70-9940-35b24929191e None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.983043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9896-1942-4d70-9940-35b24929191e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:47.987384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-492e9896-1942-4d70-9940-35b24929191e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:47.988625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:47.989943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 294/597] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:47.990918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9896-1942-4d70-9940-35b24929191e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.024813 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53475f66-00a7-4661-9951-6f4fe75e803f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.074726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.075738 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.076227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.076679 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.078069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:48.078219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.083872 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.096963 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 304/598] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:48.097872 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.140476 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9896-1942-4d70-9940-35b24929191e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.181705 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.182772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.183240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.183706 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.200687 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:48.210944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:48.212338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:48.213412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 295/599] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:48.214667 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.232120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9a93-2799-44c6-ba43-b00740f81b6d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.265775 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:48.293454 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:48.302109 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.303222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.303716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.304191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.321146 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.322639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:48.339677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:48.340695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:48.341971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:48.341971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:48.341971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:48.341971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 305/600] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:48.341971 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.361089 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cc1f4-5c71-4b52-a7a4-f66d9df56889 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.411076 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.411688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.412026 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.412269 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.412960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:48.413285 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.415738 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.426867 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 296/601] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:48.427745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.479544 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368e38-fb82-4b36-968d-bb25757fa0fb None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.516269 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.516911 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.517227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.517506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.525906 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.527370 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.537762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:48.539682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:48.540955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 306/602] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:48.542186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.549135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eae56-f7bb-469c-b96b-d3e80586034b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.592392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.593933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.594229 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.594500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.595187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:48.595373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:48.595503 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.596869 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.606592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 297/603] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:48.607462 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.670562 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34d50d-1536-4f8b-8c43-fac13e46f055 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.711207 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.711907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.712080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.712351 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.713051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:48.713391 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.714896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.723844 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc5eb9-2162-4bfc-8974-09dd17a1756f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.730401 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 307/604] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:48.731051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.767853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.768630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.769160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.769635 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.785381 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.787746 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:48.803321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:48.805161 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:48.807118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:48.807118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:48.807118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:48.807118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 298/605] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:48.807118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.817933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:48.876773 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3498871-0a41-4fea-b95f-16986616e7a8 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.879080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:48.920737 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68890491-3851-4dfd-b252-d7eba1827a9a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:48.928191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.928828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.929083 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.929459 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.930324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:48.930437 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.931906 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.950880 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 308/606] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:48.951655 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:48.961137 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:48.961793 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:48.962053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:48.962369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:48.978147 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:48.979533 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:48.995454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:48.997607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:48.999178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:48.999178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:48.999178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:48.999178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 299/607] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:48.999178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.063447 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.081314 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf5007-9d51-4a87-8525-1910b9e6e190 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.108016 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea7747-001e-43ac-835b-4777d7269ad4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.119645 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.120323 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.120592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.120854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.129570 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.130992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:49.145008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:49.146881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 309/608] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:49.148089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.153189 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.153991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.154341 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.154611 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.155416 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:49.155740 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.157225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.170615 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 300/609] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:49.171952 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.176810 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.267502 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c8460-9d87-4bc8-8dad-ca89905d9f89 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.285061 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c890d-b1c3-42c0-9f17-e62b26ad4a77 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.307308 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.308192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.308312 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.308437 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.308437 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.325526 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.326140 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.326412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.326677 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.327356 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:49.327653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.329055 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.341420 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 301/610] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:49.342029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.391223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.392642 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.414956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.467939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fb0a1-df63-42e1-9020-f39fd8e17e65 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.516261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.516885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.517172 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.517469 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.518204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:49.518508 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.519932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.534253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 310/611] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:49.535660 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.544474 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 302/612] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:49.545197 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.599309 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.666600 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e681d7-acbc-458b-a168-21dd8706f383 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.671212 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826351d-753f-4c19-971b-91411df81a62 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.691378 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.705930 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.706179 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.706560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.706798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.706893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.707070 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.707173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.707337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] PATH_INFO: `/v3/users/glance` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.714416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.714985 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.715838 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.715960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:49.727247 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:49.728368 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:39:49.734200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:49.734776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:49.736097 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 303/613] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:49.737241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.738036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 311/614] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:49.738036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.835156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.839204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccd777-574b-48ab-842a-3dd5763c94a3 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.840151 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc59d2-4db4-42a1-9cbc-844d00e6d467 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:49.872393 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.873025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.873332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.873426 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:49.873602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.873966 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.874323 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.874581 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.884758 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.886284 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:49.901038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:49.902012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:49.903104 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:49.903104 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:49.903104 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:49.903104 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 304/615] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:49.903567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:49.925945 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.948223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:49.949762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.005556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0912-f178-4323-9ac2-e30f6e453bb0 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.041089 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.041737 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.042011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.042280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.042996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:50.043299 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.044796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.054413 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 312/616] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:50.055291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.063763 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 305/617] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 22 20:39:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:50.064593 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.075242 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.141775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.164590 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6ee86-e4ec-4729-b8e6-d2ea16b57f5b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.172961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a244e-5219-4b5c-8891-98ac2ed044c2 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.198930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.199366 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.199639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.199906 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.200684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:50.200923 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.203169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.206668 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.207265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.207535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.207799 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.208428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:50.208720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.210086 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.220911 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 313/618] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:50.221865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.222542 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 306/619] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:50.226999 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.298769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.323577 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed79f1-0dd8-45f5-af4a-45a8c274cade None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.336339 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed71b-d85b-4903-a789-41ceacea4117 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.359300 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.359932 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.360207 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.360474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.367435 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.370942 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.372737 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.373113 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.373735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.374011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.374283 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:50.390640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:50.391682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:50.392724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:50.392724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:50.392724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:50.392724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 314/620] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:50.393432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.459068 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.460438 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.501868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7aac0-331b-47ad-a0a1-aa99940724fb None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.536755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.538955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.539731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.540187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.540597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.578020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 307/621] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:50.579162 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.620265 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.631338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.633173 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.687857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b3cf4-29c6-4ffa-8daf-1b6c51eb5907 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.736108 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.736993 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.737477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.737908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.746281 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 315/622] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:50.747158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.748503 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.750270 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:50.763207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:50.768934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 308/623] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:50.770335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.801466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.868284 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.881006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e7991-4eee-4697-9aa2-16e24121696e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.895614 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d7ecd-a617-4eb8-9938-816f3a21f40b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.919766 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.920445 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.920646 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.921283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.922120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:50.922420 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.923885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.934996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.935637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.935909 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.936178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.936518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 316/624] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:50.937383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.950831 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.952382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:50.967639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:50.968697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:50.969657 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:50.969657 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:50.969657 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:50.969657 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 309/625] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:50.969893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.047687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb2a8-d941-4eb0-9cf2-1621337bc08a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.060399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:51.082913 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56195d9-0d05-43b8-946f-600e6fa2925e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.083965 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.084597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.084867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.085147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.096847 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.098371 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:51.113192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:51.114253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:51.115133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:51.115133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:51.115133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:51.115133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 317/626] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:51.115354 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.118025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:51.124200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33958328-8eff-40db-af65-b556efb32349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.124821 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33958328-8eff-40db-af65-b556efb32349 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.125122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33958328-8eff-40db-af65-b556efb32349 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.125396 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33958328-8eff-40db-af65-b556efb32349 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.126085 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33958328-8eff-40db-af65-b556efb32349 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:51.126387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33958328-8eff-40db-af65-b556efb32349 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.127810 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33958328-8eff-40db-af65-b556efb32349 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.140625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 310/627] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:51.141520 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33958328-8eff-40db-af65-b556efb32349 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.231031 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffdf63-a534-47b9-a681-db32cf5dd895 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.259396 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33958328-8eff-40db-af65-b556efb32349 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.267603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.268232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.268508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.268776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.275740 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.277251 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:51.288881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:51.289924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 318/628] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:51.290804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.300865 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.301516 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.301696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.301994 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.302631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:51.302925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.304296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.313821 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:51.317437 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 311/629] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:51.322222 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.355980 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:51.397397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c45f6-e964-40ee-a4b1-6d24df4efd0f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.420324 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157cb6f-26de-4586-82f9-052b3be5411d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.436080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.437338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.437772 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.438116 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.438991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:51.439362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.443491 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.453139 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 319/630] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:51.453943 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.456271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.456875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.457179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.457592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.458324 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=26fd52c94dc342eea817105f34e48190) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:51.458618 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.460066 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.466548 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 312/631] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/role_assignments?user.id=26fd52c94dc342eea817105f34e48190&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:51.467519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.558136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:51.575348 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08819f3-fd43-4285-aa7f-3083814c3bc9 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.603885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:51.604731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddcb28-6342-46da-bc97-91f1ed332b9a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.619174 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.619792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.620085 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.620336 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.621040 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:51.621372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.622862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.638171 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 320/632] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:51.639262 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.662875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.664023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.664475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.665256 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.676357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.677973 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:51.690754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:51.691698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:51.692575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:51.693599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 313/633] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:51.698655 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.766883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba4408-7ec1-4982-9822-33d06059a5d7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.804948 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.805603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.805859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.806128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.813582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.814948 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.830147 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1d609-09e3-4538-9d57-8d4c3d5b5b1b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:51.836484 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:51.837668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:51.838567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:51.840340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 321/634] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:51.841423 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.857432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:51.868850 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:51.869508 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:51.869779 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:51.870042 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:51.870751 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=2e0c0dc1360a4dce928cbc27eab76ae1) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:51.871053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:51.872464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:51.879220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 314/635] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/role_assignments?user.id=2e0c0dc1360a4dce928cbc27eab76ae1&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:51.879925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:51.909665 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:52.002406 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4240f-c1f4-4212-acf5-9e8b1b5309c1 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:52.053156 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:52.053798 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:52.054077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:52.054349 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:52.055078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:52.055465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:52.056983 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:52.071833 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119273-8105-49e3-b88b-9b51625c97a5 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:52.072885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 322/636] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:52.078870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:52.114809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:52.115992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:52.116273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:52.116550 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:52.117307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:52.117622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:52.119085 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:52.140784 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 315/637] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:52.142127 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:52.222604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:52.228345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344989b-e08a-4efa-8744-ebf1f93c362c None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:52.230543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:52.272945 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849111f1-b307-4f0d-a6e9-c1768051f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:52.273848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849111f1-b307-4f0d-a6e9-c1768051f521 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:52.274276 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849111f1-b307-4f0d-a6e9-c1768051f521 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:52.274687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849111f1-b307-4f0d-a6e9-c1768051f521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:52.275586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849111f1-b307-4f0d-a6e9-c1768051f521 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=68490ffb61b54cc78d3104049f0e03ae) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:52.276059 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849111f1-b307-4f0d-a6e9-c1768051f521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:52.277818 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849111f1-b307-4f0d-a6e9-c1768051f521 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:52.287163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 323/638] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:52 2022] GET /identity/v3/role_assignments?user.id=68490ffb61b54cc78d3104049f0e03ae&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:52.306772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c32828-4a19-43a5-866f-1e3c2111cdc0 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:52.349321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba6de-5baa-4e7f-8347-140dabaa1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:52.350409 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba6de-5baa-4e7f-8347-140dabaa1d94 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:52.350886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba6de-5baa-4e7f-8347-140dabaa1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:52.351352 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba6de-5baa-4e7f-8347-140dabaa1d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:52.352305 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba6de-5baa-4e7f-8347-140dabaa1d94 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=f344891bb32f4d86ab3c2536c3a4ae68) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:52.352896 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba6de-5baa-4e7f-8347-140dabaa1d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:52.354662 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba6de-5baa-4e7f-8347-140dabaa1d94 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:52.362309 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 316/639] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:52 2022] GET /identity/v3/role_assignments?user.id=f344891bb32f4d86ab3c2536c3a4ae68&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:53.852587 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753160-42a2-428d-a7c9-29e9e759dd20 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:53.853175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753160-42a2-428d-a7c9-29e9e759dd20 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:53.853175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753160-42a2-428d-a7c9-29e9e759dd20 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:53.854741 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 324/640] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:53.860517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88adb6d-f7cc-469b-b64f-6927b2887539 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:53.860951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88adb6d-f7cc-469b-b64f-6927b2887539 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:53.861152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88adb6d-f7cc-469b-b64f-6927b2887539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:53.879807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b88adb6d-f7cc-469b-b64f-6927b2887539 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:53.880990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b88adb6d-f7cc-469b-b64f-6927b2887539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:53.958899 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 317/641] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:54.284596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753160-42a2-428d-a7c9-29e9e759dd20 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:54.317075 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543adca-dc81-42ea-8225-610e8e098897 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.317442 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543adca-dc81-42ea-8225-610e8e098897 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.317657 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543adca-dc81-42ea-8225-610e8e098897 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.319247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 318/642] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:54.325254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f34456-97ef-4349-8ff8-ac0fd3809306 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.325574 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f34456-97ef-4349-8ff8-ac0fd3809306 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.325796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f34456-97ef-4349-8ff8-ac0fd3809306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.354676 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-f2f34456-97ef-4349-8ff8-ac0fd3809306 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:54.355875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-f2f34456-97ef-4349-8ff8-ac0fd3809306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:54.402707 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:54.438764 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753160-42a2-428d-a7c9-29e9e759dd20 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:54.447094 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 319/643] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:54.497922 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:54.498915 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.499399 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.499868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.521747 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:39:54.526956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:54.527991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:54.528881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 325/644] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:54.534247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f34456-97ef-4349-8ff8-ac0fd3809306 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:54.653130 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f34456-97ef-4349-8ff8-ac0fd3809306 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:54.694482 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33ea94-7d86-4d5d-ab10-ecdb986b872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:54.695101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33ea94-7d86-4d5d-ab10-ecdb986b872f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.695375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33ea94-7d86-4d5d-ab10-ecdb986b872f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.695636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33ea94-7d86-4d5d-ab10-ecdb986b872f None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.696355 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33ea94-7d86-4d5d-ab10-ecdb986b872f None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:54.696651 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33ea94-7d86-4d5d-ab10-ecdb986b872f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:54.698111 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33ea94-7d86-4d5d-ab10-ecdb986b872f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:54.712069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 320/645] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:54.714184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:54.746889 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61022-1882-4815-8b91-c1c3c65260ce None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.747204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61022-1882-4815-8b91-c1c3c65260ce None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.747702 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61022-1882-4815-8b91-c1c3c65260ce None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.748880 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:54.749327 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 321/646] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:54.755148 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e849-de26-4bf9-82dc-882d19a305a1 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.755475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e849-de26-4bf9-82dc-882d19a305a1 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.755737 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e849-de26-4bf9-82dc-882d19a305a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.775794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-4b46e849-de26-4bf9-82dc-882d19a305a1 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:54.777624 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-4b46e849-de26-4bf9-82dc-882d19a305a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:54.809802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:54.840949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08378bcb-5429-4e58-adda-d9be59addc00 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:54.852520 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 322/647] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:54.853845 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5737ed-07e1-436c-bc11-92bf1c5a21a3 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.854126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5737ed-07e1-436c-bc11-92bf1c5a21a3 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.854394 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5737ed-07e1-436c-bc11-92bf1c5a21a3 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.855791 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 323/648] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:54.856295 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5737ed-07e1-436c-bc11-92bf1c5a21a3 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:54.879377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034899e-5c9b-42f3-86fc-9420e337202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:54.879982 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034899e-5c9b-42f3-86fc-9420e337202c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.880267 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034899e-5c9b-42f3-86fc-9420e337202c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.880540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034899e-5c9b-42f3-86fc-9420e337202c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.892782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034899e-5c9b-42f3-86fc-9420e337202c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:54.894345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034899e-5c9b-42f3-86fc-9420e337202c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-0034899e-5c9b-42f3-86fc-9420e337202c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:54.908854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:54.909976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:54.910857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:54.910857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:54.910857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:54.910857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 326/649] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:54.911715 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39428-abc9-4d4f-8815-5bb1f9555590 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:54.911715 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39428-abc9-4d4f-8815-5bb1f9555590 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:54.911715 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39428-abc9-4d4f-8815-5bb1f9555590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:54.930574 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-b9c39428-abc9-4d4f-8815-5bb1f9555590 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:54.932230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-b9c39428-abc9-4d4f-8815-5bb1f9555590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:54.976995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5737ed-07e1-436c-bc11-92bf1c5a21a3 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.001586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 327/650] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:55.002779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39428-abc9-4d4f-8815-5bb1f9555590 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.015357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.033421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.034062 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.034330 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.034596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.035176 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.036536 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:55.051743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:55.052817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:39:55.054407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:55.062212 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 324/651] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 22 20:39:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:55.063932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.103810 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.128338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39428-abc9-4d4f-8815-5bb1f9555590 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.183714 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.185318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.186063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.186631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.187650 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:55.187938 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdb5b9-40bf-48ae-ad2f-22768f8bbe7c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.188395 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.191383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.207104 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 328/652] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:55.208226 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.225005 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.225656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.225936 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.226194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.226817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:55.227114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.228495 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.238319 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 325/653] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:55.238319 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.319101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.353474 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.362862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b039f0-faac-4fe7-a146-c5adbf26e50f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.366535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888df1c-4de6-4a36-a17f-c6ff1e335672 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.401122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.401875 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.402220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.402555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] PATH_INFO: `/v3/services/image` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.403205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.403570 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.404203 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.404477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.404745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.404984 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.413200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.414645 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:55.416513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:55.417599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:39:55.418419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 329/654] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:55.419202 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:39:55.428951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:55.430169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 326/655] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:55.431250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.532372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fad9a-4e68-4d30-959c-33adaff730da None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.534485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6953-5ca7-4a9a-ab01-67cb8e051708 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.569697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.575239 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.575892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.576133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.576310 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.576466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] PATH_INFO: `/v3/services/network` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.576736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.577246 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.577443 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.577710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.578340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:55.578636 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.578789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.580021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.592175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 330/656] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:55.592175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:55.592556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:55.593935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:55.594893 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 327/657] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:55.596101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.624338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.735400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9fb25-2e21-4d36-8a2e-b8ad9a7907bc None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.771001 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec151a-da3f-4d35-9a2e-6edf1aa58db6 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.782132 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.782855 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.783222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.783554 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.784260 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] RBAC: Adding query filter params (name=image) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:55.784637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.786157 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.792327 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 331/658] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:55.792923 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.829657 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.830267 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.830490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.830754 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.831514 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:55.831827 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.833460 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.861184 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 328/659] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:55.861184 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.866436 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.920321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef796d-8ed4-4971-aa4b-336208f4abb1 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:55.957882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:55.968670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:55.969309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:55.969599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:55.969837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:55.970460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] RBAC: Adding query filter params (name=network) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:55.970756 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:55.972339 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:55.979712 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 332/660] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:55.981130 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:55.995168 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23815f-11aa-49ea-8e2b-6049cf702848 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:56.036907 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:56.037560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:56.037829 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:56.038093 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:56.038723 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] RBAC: Adding query filter params (type=image) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:56.039020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:56.040447 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:56.046644 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 329/661] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:56.047465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:56.130328 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347f72-a57a-4a3d-85cb-4368fb3d4655 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:56.159295 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:56.176287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:56.177304 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:56.177751 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:56.178183 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:56.224011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d06f-130d-4c67-9850-a74ec412458d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:56.275833 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:56.277065 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:56.277460 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:56.277632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:56.278271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] RBAC: Adding query filter params (type=network) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:56.278576 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:56.279814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:56.280600 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:56.281614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:56.288956 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 330/662] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:39:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:56.422277 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 333/663] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:39:56.428696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:56.443205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:56.584635 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccca32-ee7f-4e68-89ff-90e526ad9527 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:56.629784 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:56.630435 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:56.630713 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:56.630985 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:56.644633 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:56.646659 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:39:56.662950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:56.663951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:39:56.664826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:39:56.664826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:39:56.664826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:56.664826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 331/664] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:39:56.670301 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:56.698978 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:56.784319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900dad3-b8f1-48be-8f2d-5ec9a2f7dbd8 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:56.823382 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:56.824199 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:56.824483 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:56.824757 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:56.825454 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:56.825763 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:56.827886 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:56.841592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 334/665] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:39:56.848418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:56.929054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:56.979810 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000b4e2-6d20-453e-9bd7-48a332775a00 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:57.031399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:57.033733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:57.034552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:57.035268 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:57.049220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:57.052440 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:39:57.075347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:39:57.077200 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:39:57.079397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:39:57.082786 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 332/666] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:39:57.092547 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:57.226164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:57.252299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933e9f1-c8e1-4e40-84f8-15804ab33b06 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:57.292663 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e6036-477f-4093-ac32-351c128918a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:57.293307 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e6036-477f-4093-ac32-351c128918a3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:57.293592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e6036-477f-4093-ac32-351c128918a3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:57.293907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e6036-477f-4093-ac32-351c128918a3 None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:57.294565 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e6036-477f-4093-ac32-351c128918a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:57.294910 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e6036-477f-4093-ac32-351c128918a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:57.296789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e6036-477f-4093-ac32-351c128918a3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:57.310935 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 335/667] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:57.317306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:57.430067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da951-863b-4ca0-a8f5-e310b4a65614 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:57.445647 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:57.473594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5bf14-80f6-44e9-a989-38dd0680847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:57.474216 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5bf14-80f6-44e9-a989-38dd0680847e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:57.474495 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5bf14-80f6-44e9-a989-38dd0680847e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:57.474768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5bf14-80f6-44e9-a989-38dd0680847e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:57.475494 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5bf14-80f6-44e9-a989-38dd0680847e None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=26fd52c94dc342eea817105f34e48190) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:39:57.475805 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5bf14-80f6-44e9-a989-38dd0680847e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:57.477350 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5bf14-80f6-44e9-a989-38dd0680847e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:57.483987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 333/668] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:39:57 2022] GET /identity/v3/role_assignments?user.id=26fd52c94dc342eea817105f34e48190&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:39:58.134061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4976a2-2c8c-4e11-91e6-99f2d9cf41e3 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:58.135086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4976a2-2c8c-4e11-91e6-99f2d9cf41e3 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:58.135589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4976a2-2c8c-4e11-91e6-99f2d9cf41e3 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:58.140386 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 336/669] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:58.146728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264791e-4957-425c-b9a9-58b2c583efdc None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:58.147753 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264791e-4957-425c-b9a9-58b2c583efdc None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:58.148237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264791e-4957-425c-b9a9-58b2c583efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:58.167667 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-6264791e-4957-425c-b9a9-58b2c583efdc None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:58.169242 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-6264791e-4957-425c-b9a9-58b2c583efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:58.261237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 334/670] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:58.462900 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160bfd-faa9-45af-bc8b-5abbd0b3f6c9 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:58.463077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160bfd-faa9-45af-bc8b-5abbd0b3f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:58.463353 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160bfd-faa9-45af-bc8b-5abbd0b3f6c9 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:58.464927 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 337/671] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:58.470679 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6bd3-8a2b-4a33-a8d1-ecfafaf5f0a5 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:58.470969 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6bd3-8a2b-4a33-a8d1-ecfafaf5f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:58.471239 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6bd3-8a2b-4a33-a8d1-ecfafaf5f0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:58.490375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-3bfb6bd3-8a2b-4a33-a8d1-ecfafaf5f0a5 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:58.491586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-3bfb6bd3-8a2b-4a33-a8d1-ecfafaf5f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:58.569666 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 335/672] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:39:58.621219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160bfd-faa9-45af-bc8b-5abbd0b3f6c9 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:58.744868 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef23e-1836-42e5-9972-df0e0a626701 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:58.745046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef23e-1836-42e5-9972-df0e0a626701 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:58.745358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef23e-1836-42e5-9972-df0e0a626701 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:58.746987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 336/673] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:58.753340 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75b74-72f4-43d1-ba2f-7100ca17dbea None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:58.753639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75b74-72f4-43d1-ba2f-7100ca17dbea None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:58.753878 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75b74-72f4-43d1-ba2f-7100ca17dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:58.761128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160bfd-faa9-45af-bc8b-5abbd0b3f6c9 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:58.776069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e7a75b74-72f4-43d1-ba2f-7100ca17dbea None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:58.777674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e7a75b74-72f4-43d1-ba2f-7100ca17dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:58.804625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:58.805294 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:58.805572 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:58.805839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:58.806517 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:58.808151 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:58.823913 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:58.831809 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 338/674] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:39:58 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:39:58.888697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 337/675] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:39:58.918155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:58.922763 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:59.056530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cd65f-cee0-483d-8f15-3b1ae63d447b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:59.100179 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74d457-ea4d-429c-b42a-99d0d8f5f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:59.100792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74d457-ea4d-429c-b42a-99d0d8f5f1c8 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:59.101075 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74d457-ea4d-429c-b42a-99d0d8f5f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:59.101418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74d457-ea4d-429c-b42a-99d0d8f5f1c8 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:59.102018 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74d457-ea4d-429c-b42a-99d0d8f5f1c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:59.103428 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74d457-ea4d-429c-b42a-99d0d8f5f1c8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:59.124114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 339/676] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:39:58 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:39:59.287147 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75b74-72f4-43d1-ba2f-7100ca17dbea None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:59.429518 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75b74-72f4-43d1-ba2f-7100ca17dbea None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:59.474010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded3939-4be4-4631-bbdd-bc23d1ebfd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:59.474622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded3939-4be4-4631-bbdd-bc23d1ebfd5a None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:59.474897 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded3939-4be4-4631-bbdd-bc23d1ebfd5a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:59.475160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded3939-4be4-4631-bbdd-bc23d1ebfd5a None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:59.475821 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded3939-4be4-4631-bbdd-bc23d1ebfd5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:59.477237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded3939-4be4-4631-bbdd-bc23d1ebfd5a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:59.498517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 338/677] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:39:59 2022] POST /identity/v3/services => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:40:00.156327 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e385-3ad5-4768-aca5-856eaaa35580 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:00.157194 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e385-3ad5-4768-aca5-856eaaa35580 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:00.157194 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e385-3ad5-4768-aca5-856eaaa35580 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:00.158518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 340/678] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:00.163825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d38a-85f4-43fe-9a91-d0b75fba27d5 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:00.164131 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d38a-85f4-43fe-9a91-d0b75fba27d5 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:00.164393 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d38a-85f4-43fe-9a91-d0b75fba27d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:00.182792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-62b7d38a-85f4-43fe-9a91-d0b75fba27d5 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:00.183961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-62b7d38a-85f4-43fe-9a91-d0b75fba27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:00.198401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:00.262576 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 339/679] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:00.588292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e385-3ad5-4768-aca5-856eaaa35580 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:00.655310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:00.696500 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e385-3ad5-4768-aca5-856eaaa35580 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:00.734178 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:00.735236 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:00.735744 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:00.736234 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:00.747727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:40:00.753186 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:00.754172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:40:00.755122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:00.758144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 341/680] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:00.769135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d38a-85f4-43fe-9a91-d0b75fba27d5 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:00.886671 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d38a-85f4-43fe-9a91-d0b75fba27d5 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:00.927470 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:00.928094 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:00.928482 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:00.928957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:00.930058 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:00.930421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:00.931805 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:00.941835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 340/681] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:00.947396 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:01.060578 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8772166-b4a9-40c1-8828-6df481b023e0 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:01.085362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:01.096242 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:01.097204 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.097837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.098109 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.110548 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:01.112220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:40:01.127136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:01.128200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:40:01.129196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:40:01.129196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:01.129196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:01.129196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 342/682] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:01.134610 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:01.146857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:01.245600 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dd02-8cc2-4881-ba14-ecde0be370d4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:01.282794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfafa74-2f59-4d17-867d-b2537f2dc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:01.283418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfafa74-2f59-4d17-867d-b2537f2dc847 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.283693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfafa74-2f59-4d17-867d-b2537f2dc847 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.283967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfafa74-2f59-4d17-867d-b2537f2dc847 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.284616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfafa74-2f59-4d17-867d-b2537f2dc847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:01.284917 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfafa74-2f59-4d17-867d-b2537f2dc847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:01.286321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfafa74-2f59-4d17-867d-b2537f2dc847 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:01.300065 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 341/683] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:01.305479 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:01.395504 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be272-337d-458e-b8a8-a63981aa6c32 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.395892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be272-337d-458e-b8a8-a63981aa6c32 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.396065 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be272-337d-458e-b8a8-a63981aa6c32 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.397762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 342/684] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:40:01.403442 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f656-3c12-4230-a2af-86456cd7294a None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.403793 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f656-3c12-4230-a2af-86456cd7294a None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.403991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f656-3c12-4230-a2af-86456cd7294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.418670 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2783d-3807-41ff-bd2c-39f7114f2762 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:01.424963 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-8f57f656-3c12-4230-a2af-86456cd7294a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:01.426239 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-8f57f656-3c12-4230-a2af-86456cd7294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:01.456937 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:01.457622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.457892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.458154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.466395 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:01.468052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:40:01.480019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:01.481054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:01.482046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 343/685] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 22 20:40:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:01.487565 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:01.496687 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:01.512025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 343/686] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:01.525572 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:01.598901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2aa5f-e1ca-427a-baa4-9accb5be75e0 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.599463 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2aa5f-e1ca-427a-baa4-9accb5be75e0 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.599968 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2aa5f-e1ca-427a-baa4-9accb5be75e0 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.601881 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 344/687] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:01.605969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ecb2-28f1-4685-a965-4caed7983f33 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:01.607589 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857915f-c47e-4cb1-a37d-f3667ee07260 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.608903 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857915f-c47e-4cb1-a37d-f3667ee07260 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.609438 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857915f-c47e-4cb1-a37d-f3667ee07260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.630831 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e857915f-c47e-4cb1-a37d-f3667ee07260 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:01.633206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e857915f-c47e-4cb1-a37d-f3667ee07260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:01.651829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:01.652358 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.652630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.652929 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.653742 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:01.654043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:01.655782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:01.676197 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 344/688] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 22 20:40:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:01.681939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:01.716432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 345/689] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:01.790860 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:01.798081 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb4853-8d2e-472a-be45-cf3392f53d61 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:01.834337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:01.834987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:01.835255 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:01.835571 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:01.847138 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:01.848611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:40:01.864086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:01.865069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:40:01.866630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:40:01.866630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:01.866630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:01.866630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 345/690] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:01.871299 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857915f-c47e-4cb1-a37d-f3667ee07260 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:01.871793 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:01.977411 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9a7fc-c2f8-4c9c-9dbc-f98b5eff4152 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:01.982638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857915f-c47e-4cb1-a37d-f3667ee07260 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.011174 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.013161 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f16e7-7c45-4dc9-950c-328fcf3eff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.013777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f16e7-7c45-4dc9-950c-328fcf3eff77 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.014062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f16e7-7c45-4dc9-950c-328fcf3eff77 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.014328 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f16e7-7c45-4dc9-950c-328fcf3eff77 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.015075 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f16e7-7c45-4dc9-950c-328fcf3eff77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:02.015379 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f16e7-7c45-4dc9-950c-328fcf3eff77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.016745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f16e7-7c45-4dc9-950c-328fcf3eff77 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.021365 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.021999 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.022273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.022567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.023156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.024984 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.034311 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 346/691] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:02.036769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021934-ffc3-43f0-bfaa-455362aa5ac6 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.036769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021934-ffc3-43f0-bfaa-455362aa5ac6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.036769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021934-ffc3-43f0-bfaa-455362aa5ac6 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:02.037054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:02.043401 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.044298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 346/692] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 22 20:40:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:02.045174 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.045298 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 347/693] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:02.046340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4021934-ffc3-43f0-bfaa-455362aa5ac6 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.058114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.150245 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04990f2-b416-4ef4-a2e8-c4a2378da9cd None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.155171 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4021934-ffc3-43f0-bfaa-455362aa5ac6 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.184898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.185558 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.186187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.186187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.192557 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e333c05-9f10-4905-a306-d8baa5e67234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.193048 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.193220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333c05-9f10-4905-a306-d8baa5e67234 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.193499 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333c05-9f10-4905-a306-d8baa5e67234 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.193769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333c05-9f10-4905-a306-d8baa5e67234 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.194402 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e333c05-9f10-4905-a306-d8baa5e67234 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:02.194543 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.194703 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e333c05-9f10-4905-a306-d8baa5e67234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.196065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e333c05-9f10-4905-a306-d8baa5e67234 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.201880 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 348/694] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:02.203333 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733338-83f9-493c-9882-5efed6e9bb53 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.203628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733338-83f9-493c-9882-5efed6e9bb53 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.203899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733338-83f9-493c-9882-5efed6e9bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:40:02.208530 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:02.209524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.210459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 347/695] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:02.210983 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.223762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-47733338-83f9-493c-9882-5efed6e9bb53 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:02.224990 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-47733338-83f9-493c-9882-5efed6e9bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:02.274806 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.297245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.302656 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 349/696] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:02.303626 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47733338-83f9-493c-9882-5efed6e9bb53 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.327819 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbccd3-6a76-4844-a273-e533adf69059 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.369024 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.369686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.369960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.370224 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] PATH_INFO: `/v3/services/image` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.370900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.372283 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:02.381957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:02.382997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.383861 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 348/697] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:02.384647 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.450354 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47733338-83f9-493c-9882-5efed6e9bb53 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.487315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.487929 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.488205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.488476 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.489270 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:02.489521 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.490898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.494373 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483916c-8737-4aa2-8f3b-6eebb3ac8078 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.501390 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 350/698] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:02.501390 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.518173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.544557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.545752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.545752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.545943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.546497 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:02.546799 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.548263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.566539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 349/699] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:02.566539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.581450 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.623736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb35f60-c683-478f-b361-47d3e6286d16 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.664491 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.665124 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.665398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.665664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.666291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] RBAC: Adding query filter params (name=image) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:02.666588 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.667965 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.672886 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 351/700] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:02.673796 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.693791 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c75265-cd37-4f4f-baa1-507068916171 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.729961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.730576 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.730852 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.731121 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.731814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] RBAC: Adding query filter params (interface=public, service_id=137c16ee8b4f4d8c8f3d23da9ccee00e, region_id=RegionOne) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:02.732160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.733588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.741527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 350/701] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/endpoints?service_id=137c16ee8b4f4d8c8f3d23da9ccee00e&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:02.742296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.783574 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783aa66-c030-4841-bd57-b67c0af4279f None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.787528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.811529 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:02.820026 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.820702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.820965 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.821262 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] PATH_INFO: `/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/26fd52c94dc342eea817105f34e48190/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.823172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] RBAC: Authorizing `identity:create_grant(project_id=b23a3011ea504944be8e0d8f3394d7df, user_id=26fd52c94dc342eea817105f34e48190, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.824623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.838694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 352/702] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:40:02 2022] PUT /identity/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/26fd52c94dc342eea817105f34e48190/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:40:02.842141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.865713 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539b81-65c8-4c98-bfff-34a36290ba3a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:02.914951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:02.915875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:02.915875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:02.916131 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] PATH_INFO: `/v3/services/network` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:02.916707 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:02.918166 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:02.928134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:02.929348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:02.930219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 351/703] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:02.931025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:02.985188 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e18b0c-2546-44f9-8a1a-e6bb69b107bf None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.031144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.031683 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.031962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.032230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.032891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] RBAC: Adding query filter params (type=image) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:03.033230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.034692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.041571 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 353/704] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:03.041571 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:03.070351 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837be476-dc3d-4d33-afb8-6184d662248d None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.073562 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:03.119781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:03.122407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.123164 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.123549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.123879 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.124571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.126438 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.141138 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 352/705] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 22 20:40:02 2022] GET /identity/v3/services => generated 1002 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:40:03.141138 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:03.200791 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404015b8-9401-4abd-9b5c-d3190c24c67a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.270525 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.271253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.271603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.271958 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.272789 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:03.273245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.275000 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.285287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 354/706] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:03.286298 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:03.295410 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a7e2-04cd-4913-af9f-1b184e4369c4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.340265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.341416 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.341931 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.342468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.343517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] RBAC: Adding query filter params (interface=public, service_id=5ff67dec39a146f8af3ea3711640fd49, region_id=RegionOne) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:03.344034 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.345864 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.352964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 353/707] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 22 20:40:03 2022] GET /identity/v3/endpoints?service_id=5ff67dec39a146f8af3ea3711640fd49&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:03.358483 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:03.405273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:03.408319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d239ae-de04-46d5-868a-aa48500d82b1 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.433374 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:03.464060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.464741 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.464978 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.465245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.465912 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] RBAC: Adding query filter params (type=network) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:03.466212 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.467803 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.474282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 355/708] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:03.480919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:03.497937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274437a8-3589-4105-8298-79e8ae2f9301 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.535638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.536163 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.536435 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.536701 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.537343 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.538975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.551747 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 354/709] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 22 20:40:03 2022] GET /identity/v3/services => generated 1002 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:40:03.620335 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3079-9f90-4b9e-8c37-7203ef3be001 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.663066 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe8932-75f6-46c3-8ca9-ce3a92683faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.663697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe8932-75f6-46c3-8ca9-ce3a92683faf None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.663973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe8932-75f6-46c3-8ca9-ce3a92683faf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.664242 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe8932-75f6-46c3-8ca9-ce3a92683faf None admin] PATH_INFO: `/v3/endpoints` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.665022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe8932-75f6-46c3-8ca9-ce3a92683faf None admin] RBAC: Adding query filter params (interface=public, service_id=ac0de644cdd14f0db123714ca16c88ca, region_id=RegionOne) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:03.665373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe8932-75f6-46c3-8ca9-ce3a92683faf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.666843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe8932-75f6-46c3-8ca9-ce3a92683faf None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.676289 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 356/710] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 22 20:40:03 2022] GET /identity/v3/endpoints?service_id=ac0de644cdd14f0db123714ca16c88ca&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:03.683175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:03.835174 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:03.846440 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606916c-64c6-405f-bef8-0df1a18d896a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:03.910424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ea800-97e6-4a33-b487-9de75c460508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:03.911975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea800-97e6-4a33-b487-9de75c460508 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:03.912771 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea800-97e6-4a33-b487-9de75c460508 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:03.913563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea800-97e6-4a33-b487-9de75c460508 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:03.914930 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ea800-97e6-4a33-b487-9de75c460508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:03.917809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ea800-97e6-4a33-b487-9de75c460508 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:03.931516 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 355/711] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 22 20:40:03 2022] GET /identity/v3/services => generated 1002 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:40:05.237551 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cb8b-e24b-42d3-8c6b-6b083d6c90df None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:05.238071 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cb8b-e24b-42d3-8c6b-6b083d6c90df None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:05.238071 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cb8b-e24b-42d3-8c6b-6b083d6c90df None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:05.239777 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 357/712] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:05.245413 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e0b3-43a6-4e1b-bcb2-49c3acf3f277 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:05.245906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e0b3-43a6-4e1b-bcb2-49c3acf3f277 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:05.245988 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e0b3-43a6-4e1b-bcb2-49c3acf3f277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:05.268818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e761e0b3-43a6-4e1b-bcb2-49c3acf3f277 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:05.270069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e761e0b3-43a6-4e1b-bcb2-49c3acf3f277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:05.520811 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 356/713] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:05.862797 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5cb8b-e24b-42d3-8c6b-6b083d6c90df None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:05.921677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:05.984991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5cb8b-e24b-42d3-8c6b-6b083d6c90df None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:06.014554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8982ab-0b4f-4173-a168-7fbe6fe2b830 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.014941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8982ab-0b4f-4173-a168-7fbe6fe2b830 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.015314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8982ab-0b4f-4173-a168-7fbe6fe2b830 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.020898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 357/714] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:40:06.022590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018c53f-636a-4a9c-a115-f4679ccacd40 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.022876 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018c53f-636a-4a9c-a115-f4679ccacd40 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.023150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018c53f-636a-4a9c-a115-f4679ccacd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.023332 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:06.023886 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.024164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.024435 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.036925 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:40:06.041727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:06.043340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:40:06.044812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.047283 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b018c53f-636a-4a9c-a115-f4679ccacd40 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:06.047443 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 358/715] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:06.047598 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b018c53f-636a-4a9c-a115-f4679ccacd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:06.053215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:06.121415 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 358/716] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:06 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:06.126592 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9794-9e15-4abb-9e51-8e8093653895 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.126872 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9794-9e15-4abb-9e51-8e8093653895 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.127141 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9794-9e15-4abb-9e51-8e8093653895 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.128630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 359/717] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:06.134805 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76915615-e7e6-4f42-9325-442bf231b4b4 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.134989 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76915615-e7e6-4f42-9325-442bf231b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.135268 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76915615-e7e6-4f42-9325-442bf231b4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.156500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-76915615-e7e6-4f42-9325-442bf231b4b4 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:06.157845 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-76915615-e7e6-4f42-9325-442bf231b4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:06.173652 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae33cd-66b9-4325-ab9a-5200c08f2292 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:06.174612 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:06.177545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:06.214271 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:06.214896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.215173 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.215438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.216120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] RBAC: Adding query filter params (name=admin) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:06.216421 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:06.218053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:06.234483 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 359/718] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:06.235460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:06.249728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 360/719] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:06 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:06.345844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de8d3-0e60-4bbe-9353-3ac19848906e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:06.384497 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:06.385045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.385357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.385697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.397034 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:06.398571 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:40:06.415051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:06.416063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:40:06.416996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:40:06.416996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:06.416996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.416996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 360/720] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:06.422490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76915615-e7e6-4f42-9325-442bf231b4b4 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:06.468383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:06.490988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:06.550798 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76915615-e7e6-4f42-9325-442bf231b4b4 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:06.596263 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7138d0-e359-43ce-9392-41101437c420 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:06.609078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503c2a6-0f3a-4739-a908-5a6e4d658582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:06.610069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503c2a6-0f3a-4739-a908-5a6e4d658582 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.610502 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503c2a6-0f3a-4739-a908-5a6e4d658582 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.610939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503c2a6-0f3a-4739-a908-5a6e4d658582 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.612153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503c2a6-0f3a-4739-a908-5a6e4d658582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:06.612457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503c2a6-0f3a-4739-a908-5a6e4d658582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:06.614297 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503c2a6-0f3a-4739-a908-5a6e4d658582 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:06.635177 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 361/721] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:06.635177 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868dcfc-8aa6-4438-bd80-91d0102d65cd None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.635177 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868dcfc-8aa6-4438-bd80-91d0102d65cd None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.635177 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868dcfc-8aa6-4438-bd80-91d0102d65cd None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.635177 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 362/722] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:06.637504 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868dcfc-8aa6-4438-bd80-91d0102d65cd None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:06.647806 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f1ad-446d-4f1f-9fd2-093a43f385be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:06.648461 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f1ad-446d-4f1f-9fd2-093a43f385be None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.648745 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f1ad-446d-4f1f-9fd2-093a43f385be None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.649018 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f1ad-446d-4f1f-9fd2-093a43f385be None admin] PATH_INFO: `/v3/services/image` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.649650 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604f1ad-446d-4f1f-9fd2-093a43f385be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:06.651088 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604f1ad-446d-4f1f-9fd2-093a43f385be None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:06.654656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-1604f1ad-446d-4f1f-9fd2-093a43f385be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:06.663957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:06.665019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:40:06.665940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.667011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 361/723] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:40:06.668943 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a640f-b68f-430a-9537-f73826b02438 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.669263 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a640f-b68f-430a-9537-f73826b02438 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.669537 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a640f-b68f-430a-9537-f73826b02438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.694033 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d47a640f-b68f-430a-9537-f73826b02438 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:06.695167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d47a640f-b68f-430a-9537-f73826b02438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:06.781272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 362/724] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:06 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:06.782161 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a640f-b68f-430a-9537-f73826b02438 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:06.794511 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868dcfc-8aa6-4438-bd80-91d0102d65cd None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:06.799546 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:06.839982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:06.840643 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.840923 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.841223 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.852243 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:06.853778 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:40:06.868372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:06.869539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 363/725] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:40:06.870510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:06.922027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a640f-b68f-430a-9537-f73826b02438 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:06.950593 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:06.972889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:06.974042 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:06.974513 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:06.974788 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:06.975560 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:06.976970 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:06.988533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:06.989688 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:06.990771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 363/726] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:06.993220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.006886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a9e4-772e-417c-886c-24cca0dee2ce None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.054468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.055475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.055918 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.056399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.057547 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] RBAC: Adding query filter params (name=image) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:07.058042 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.060575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:07.068432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 364/727] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:07.069497 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.127920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:07.162238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b5d6-4d92-422b-b3fc-739dd1b73d01 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.212459 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.213210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.213398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.213759 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.214682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:07.215191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.218089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:07.228733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4575f9-335d-48ab-b52c-1cb44b1c2a97 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.274872 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.275603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.275741 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.276018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.276702 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:07.277003 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.278467 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:07.280151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:07.285357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 365/728] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 22 20:40:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:07.286304 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.375518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 364/729] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 22 20:40:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:07.376403 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.412722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255147d-e8ed-4f0b-aa24-017be3c6c086 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.454369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.455333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.455779 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.456215 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.457263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] RBAC: Adding query filter params (type=image) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:07.457755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.459932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:07.472888 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 366/730] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:07.472888 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.498983 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e4019-aea7-4c95-9b41-daea3f41a53c None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.542742 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:07.544874 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.545876 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.546159 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.546333 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] PATH_INFO: `/v3/services/network` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.546880 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.548278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:07.550736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:07.560240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:07.562180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:07.563072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 365/731] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:07 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:07.563886 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.601162 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadc8b2-d5de-401d-810b-2435e578f12b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.636836 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.637484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.637760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.638024 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.638648 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:07.638995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.640380 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:07.653531 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 367/732] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 22 20:40:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:07.653531 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.698104 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63fa90-2a35-4462-a4b8-56cc8a6c8c8b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.743901 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.744412 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.744685 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.744953 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.772260 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39221688-4b2c-4644-a454-30a5c57bfb3c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:07.799406 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:07.811054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:07.812214 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:07.812486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:07.812772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:07.813768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.815704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:07.838041 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:07.844738 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:07.845358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 368/733] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:40:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:07.846245 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:07.847411 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:08.003829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 366/734] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:40:07 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:40:08.003829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:08.027234 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc9e5-ccf6-4f61-9649-33801fb6b759 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:08.080347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:08.081003 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:08.081940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:08.081940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:08.082233 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] RBAC: Adding query filter params (name=network) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:08.082540 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:08.083955 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:08.095507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 369/735] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:08.095507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:08.161554 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:08.165343 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:08.168968 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18316a-8047-4543-8124-d2a978534e51 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:08.221160 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:08.221951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:08.222871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:08.223275 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:08.224406 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:08.226301 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:08.249002 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac18d-090a-4305-beb1-e867d005702c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:08.266051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 367/736] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:40:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:08.267702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:08.333654 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:08.335568 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:08.336896 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:08.337722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:08.365081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:08.368074 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:40:08.395446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:08.397506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:40:08.399428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:40:08.399428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:08.399428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:08.402457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 370/737] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:08.409877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:08.495466 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce876e2-4f8c-4c6f-94e8-b86e8f8d95f2 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:08.565165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:08.566515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:08.566949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:08.567394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:08.568401 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] RBAC: Adding query filter params (type=network) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:08.570637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:08.572078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:08.580710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 368/738] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:08.586512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:08.592546 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:08.604964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2688cf-5791-4468-9d9b-6b9d544adf6e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:08.614117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:08.666319 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:08.667030 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:08.667481 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:08.668092 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:08.669302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:08.670004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:08.674593 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:08.699415 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 371/739] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:08.707146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:08.723148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe1e87-5bfd-4fe5-8219-a47933e8718d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:08.761899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:08.762373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:08.762630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:08.762866 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] PATH_INFO: `/v3/endpoints` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:08.763533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:08.764992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:08.788603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 369/740] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:40:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:08.903068 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d37ac-61dd-4dce-a61c-3c510524098b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:08.994891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:08.996334 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:08.997049 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:08.997716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:09.010695 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:09.013492 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:40:09.039957 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:09.041854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:09.043521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 372/741] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:40:09.055306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:09.184006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:09.232892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387d1e-af54-4ecc-a03a-577134a1b26d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:09.288984 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959b0ea-ee40-4eb9-aa0f-def17f04a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:09.289633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b0ea-ee40-4eb9-aa0f-def17f04a52c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:09.289908 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b0ea-ee40-4eb9-aa0f-def17f04a52c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:09.290176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b0ea-ee40-4eb9-aa0f-def17f04a52c None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:09.290874 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959b0ea-ee40-4eb9-aa0f-def17f04a52c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:09.291170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959b0ea-ee40-4eb9-aa0f-def17f04a52c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:09.292608 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959b0ea-ee40-4eb9-aa0f-def17f04a52c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:09.307520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 370/742] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:09.314824 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:09.324387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:09.455065 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520a75-d2c5-428c-8c3f-7f178828cddf None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:09.503112 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8e5de-7f72-4537-a6bd-956a838b621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:09.503725 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e5de-7f72-4537-a6bd-956a838b621a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:09.503998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e5de-7f72-4537-a6bd-956a838b621a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:09.504264 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e5de-7f72-4537-a6bd-956a838b621a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:09.504991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8e5de-7f72-4537-a6bd-956a838b621a None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=26fd52c94dc342eea817105f34e48190) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:09.505325 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8e5de-7f72-4537-a6bd-956a838b621a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:09.507098 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8e5de-7f72-4537-a6bd-956a838b621a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:09.513660 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 373/743] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:40:09 2022] GET /identity/v3/role_assignments?user.id=26fd52c94dc342eea817105f34e48190&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:10.284863 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42fc60-5f68-4eaf-8d02-c2d8bf26686e None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:10.285702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42fc60-5f68-4eaf-8d02-c2d8bf26686e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:10.285702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42fc60-5f68-4eaf-8d02-c2d8bf26686e None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:10.287060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 371/744] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:40:10.292866 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329f22-8db0-422b-b043-20859cbe5795 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:10.293278 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329f22-8db0-422b-b043-20859cbe5795 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:10.293542 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329f22-8db0-422b-b043-20859cbe5795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:10.318547 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-79329f22-8db0-422b-b043-20859cbe5795 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:10.320480 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-79329f22-8db0-422b-b043-20859cbe5795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:10.424566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:10.434385 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 374/745] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:10 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:10.757269 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42fc60-5f68-4eaf-8d02-c2d8bf26686e None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:10.835108 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2279-a997-456d-bc9f-1f7d99cdaa1f None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:10.835731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2279-a997-456d-bc9f-1f7d99cdaa1f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:10.835731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2279-a997-456d-bc9f-1f7d99cdaa1f None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:10.837137 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 375/746] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:10.842854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2ac9a-6df0-4aba-9dd6-c1d8d5a2f5a9 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:10.843140 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2ac9a-6df0-4aba-9dd6-c1d8d5a2f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:10.843378 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2ac9a-6df0-4aba-9dd6-c1d8d5a2f5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:10.862712 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-43b2ac9a-6df0-4aba-9dd6-c1d8d5a2f5a9 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:10.863928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-43b2ac9a-6df0-4aba-9dd6-c1d8d5a2f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:10.916697 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42fc60-5f68-4eaf-8d02-c2d8bf26686e None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:10.969357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 376/747] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:10 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:10.970398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:10.971085 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:10.971469 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:10.971901 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:10.975183 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:11.076602 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:11.078307 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:11.202255 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 372/748] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:40:10 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 20:40:11.207992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2ac9a-6df0-4aba-9dd6-c1d8d5a2f5a9 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:11.334043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:11.364843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2ac9a-6df0-4aba-9dd6-c1d8d5a2f5a9 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:11.389077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:11.411338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:11.422110 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:11.423125 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:11.423577 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:11.424003 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:11.440426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:11.442831 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:40:11.458979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:11.460937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:40:11.462802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:40:11.462802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:40:11.462802 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:11.465562 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 377/749] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:40:11.466527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:11.493475 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf29533-a343-40d1-8c83-cdde8ac0802b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:11.534391 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:11.535017 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:11.535285 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:11.535562 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:11.536125 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:11.537531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:11.548758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:11.549961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:11.551209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:11.553725 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 373/750] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:11.556729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:11.621430 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46a1d-b8c3-4b10-bf99-35eae3c8913f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:11.658403 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:11.659033 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:11.659309 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:11.659580 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:11.660232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:11.660529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:11.661962 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:11.676262 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 378/751] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:11.692992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:11.700230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d0566-05c4-4a26-beda-1bc2b03f2072 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:11.763380 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdbb36-fe3f-4ded-b067-0b0abfc730e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:11.764158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdbb36-fe3f-4ded-b067-0b0abfc730e2 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:11.764802 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdbb36-fe3f-4ded-b067-0b0abfc730e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:11.765312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdbb36-fe3f-4ded-b067-0b0abfc730e2 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:11.766318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdbb36-fe3f-4ded-b067-0b0abfc730e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:11.766814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdbb36-fe3f-4ded-b067-0b0abfc730e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:11.769234 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdbb36-fe3f-4ded-b067-0b0abfc730e2 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:11.784074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 374/752] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:11.792176 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:11.861031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:11.867965 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b02e-76ba-4a39-8a59-d53707e44ca9 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:11.868350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b02e-76ba-4a39-8a59-d53707e44ca9 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:11.868515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b02e-76ba-4a39-8a59-d53707e44ca9 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:11.870158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 375/753] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:40:11.875837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e1fe-0a57-4d51-b8ba-d942d827afcc None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:11.876083 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e1fe-0a57-4d51-b8ba-d942d827afcc None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:11.876384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e1fe-0a57-4d51-b8ba-d942d827afcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:11.902131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9735e1fe-0a57-4d51-b8ba-d942d827afcc None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:11.903408 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9735e1fe-0a57-4d51-b8ba-d942d827afcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:11.949800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae3326-e15d-4390-ad30-4e884675f959 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:12.002486 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 376/754] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:11 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:12.004295 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:12.004937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:12.005249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:12.005522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:12.006497 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:12.006806 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:12.008253 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:12.014229 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 379/755] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:12.360119 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e1fe-0a57-4d51-b8ba-d942d827afcc None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:12.474649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:12.484852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e1fe-0a57-4d51-b8ba-d942d827afcc None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:12.524991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:12.525645 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:12.525915 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:12.526179 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:12.526764 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:12.528233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:12.538061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:12.539093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:12.540019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 377/756] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 22 20:40:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:12.545678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:12.667388 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4540-9225-46e4-bd88-2fb8c0ff7194 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:12.675096 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:12.709768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f056-786f-4969-9c13-96f6e44d485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:12.710557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f056-786f-4969-9c13-96f6e44d485e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:12.710557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f056-786f-4969-9c13-96f6e44d485e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:12.711325 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f056-786f-4969-9c13-96f6e44d485e None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:12.711325 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074f056-786f-4969-9c13-96f6e44d485e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:12.712004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074f056-786f-4969-9c13-96f6e44d485e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:12.712992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074f056-786f-4969-9c13-96f6e44d485e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:12.719135 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 380/757] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 22 20:40:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:12.725378 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:12.839709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ae554-bb31-4828-8d86-15cdfcadc7b8 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:12.877154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba681-8055-4ff9-bfa4-b9170536c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:12.877767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba681-8055-4ff9-bfa4-b9170536c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:12.878041 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba681-8055-4ff9-bfa4-b9170536c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:12.878640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba681-8055-4ff9-bfa4-b9170536c4a9 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:12.878931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba681-8055-4ff9-bfa4-b9170536c4a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:12.879231 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba681-8055-4ff9-bfa4-b9170536c4a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:12.880640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba681-8055-4ff9-bfa4-b9170536c4a9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:12.885668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 378/758] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 22 20:40:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:14.267404 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646510a-0fcc-4fc7-8e24-5229b15bca6f None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:14.267978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646510a-0fcc-4fc7-8e24-5229b15bca6f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:14.268194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646510a-0fcc-4fc7-8e24-5229b15bca6f None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:14.269582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 381/759] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:14.274853 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c5dd-0da9-4478-a29e-563c57b3579d None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:14.275296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c5dd-0da9-4478-a29e-563c57b3579d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:14.275387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c5dd-0da9-4478-a29e-563c57b3579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:14.293700 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d776c5dd-0da9-4478-a29e-563c57b3579d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:14.294912 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d776c5dd-0da9-4478-a29e-563c57b3579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:14.309545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:14.365333 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 379/760] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:14 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:14.693688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646510a-0fcc-4fc7-8e24-5229b15bca6f None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:14.807468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646510a-0fcc-4fc7-8e24-5229b15bca6f None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:14.843685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd85a-801b-4ace-89b9-727e8e6f1e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:14.844287 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd85a-801b-4ace-89b9-727e8e6f1e79 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:14.844554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd85a-801b-4ace-89b9-727e8e6f1e79 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:14.844814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd85a-801b-4ace-89b9-727e8e6f1e79 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:14.845486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acd85a-801b-4ace-89b9-727e8e6f1e79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:14.846875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acd85a-801b-4ace-89b9-727e8e6f1e79 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:14.862199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 382/761] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:40:14 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:15.099470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fc2ce-0e62-41d0-a136-ad5891633b11 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:15.099793 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fc2ce-0e62-41d0-a136-ad5891633b11 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:15.100074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fc2ce-0e62-41d0-a136-ad5891633b11 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:15.102253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 380/762] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:15.110067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f675-625b-4829-9254-1e3069cf14ec None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:15.110429 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f675-625b-4829-9254-1e3069cf14ec None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:15.110708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f675-625b-4829-9254-1e3069cf14ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:15.135393 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-0782f675-625b-4829-9254-1e3069cf14ec None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:15.136578 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-0782f675-625b-4829-9254-1e3069cf14ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:15.162253 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:15.225712 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 383/763] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:15 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:15.551470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fc2ce-0e62-41d0-a136-ad5891633b11 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:15.661165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fc2ce-0e62-41d0-a136-ad5891633b11 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:15.708021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7172e6-1ebd-42b5-ac9c-b1217558cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:15.709025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7172e6-1ebd-42b5-ac9c-b1217558cbc1 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:15.709540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7172e6-1ebd-42b5-ac9c-b1217558cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:15.710081 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7172e6-1ebd-42b5-ac9c-b1217558cbc1 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:15.711231 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7172e6-1ebd-42b5-ac9c-b1217558cbc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:15.713946 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7172e6-1ebd-42b5-ac9c-b1217558cbc1 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:15.741080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 381/764] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:40:15 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:17.116689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11877-8a16-4042-a764-057ddc4ed62c None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:17.117279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11877-8a16-4042-a764-057ddc4ed62c None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:17.117279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11877-8a16-4042-a764-057ddc4ed62c None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:17.118681 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 384/765] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:17.124652 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5a37-6605-4a99-9b66-130e0a0bdbbf None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:17.125280 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5a37-6605-4a99-9b66-130e0a0bdbbf None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:17.125614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5a37-6605-4a99-9b66-130e0a0bdbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:17.147576 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-532b5a37-6605-4a99-9b66-130e0a0bdbbf None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:17.148783 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-532b5a37-6605-4a99-9b66-130e0a0bdbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:17.151999 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:17.229718 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 382/766] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:17.573198 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11877-8a16-4042-a764-057ddc4ed62c None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:17.723087 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11877-8a16-4042-a764-057ddc4ed62c None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:17.770738 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:17.771402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:17.771671 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:17.771936 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:17.771936 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:17.774017 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:17.784557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:17.786071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:17.787046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 385/767] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:17.791841 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5a37-6605-4a99-9b66-130e0a0bdbbf None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:17.918684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5a37-6605-4a99-9b66-130e0a0bdbbf None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:17.957990 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac362d-c0b7-4cc9-9873-dadb43ec5a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:17.958595 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac362d-c0b7-4cc9-9873-dadb43ec5a29 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:17.958868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac362d-c0b7-4cc9-9873-dadb43ec5a29 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:17.959117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac362d-c0b7-4cc9-9873-dadb43ec5a29 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:17.959767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac362d-c0b7-4cc9-9873-dadb43ec5a29 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:17.960063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac362d-c0b7-4cc9-9873-dadb43ec5a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:17.961540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac362d-c0b7-4cc9-9873-dadb43ec5a29 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:17.965411 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:17.968758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 383/768] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:17.974399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:17.994993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64885e-f801-4e07-bbc3-d762931da592 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:17.995399 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64885e-f801-4e07-bbc3-d762931da592 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:17.995667 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64885e-f801-4e07-bbc3-d762931da592 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:17.997062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 384/769] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:40:18.000146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:18.003920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bae29-aca1-4ab6-8ea4-2cbf9fc5c26f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:18.004220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bae29-aca1-4ab6-8ea4-2cbf9fc5c26f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:18.004492 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bae29-aca1-4ab6-8ea4-2cbf9fc5c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:18.024596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9b4bae29-aca1-4ab6-8ea4-2cbf9fc5c26f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:18.025853 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9b4bae29-aca1-4ab6-8ea4-2cbf9fc5c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:18.103550 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478493-d970-4046-a3d0-4277e88745f6 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:18.109287 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 385/770] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:18 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:18.141964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:18.142596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:18.142871 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:18.143138 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:18.143963 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:18.144125 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:18.145573 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:18.151308 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 386/771] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:18.158950 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bae29-aca1-4ab6-8ea4-2cbf9fc5c26f None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:18.308076 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bae29-aca1-4ab6-8ea4-2cbf9fc5c26f None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:18.355681 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:18.364884 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:18.365757 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:18.366124 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:18.366476 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:18.367300 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] RBAC: Adding query filter params (interface=public, service_id=506488273f714f52b0059fcc294bf6c2, region_id=RegionOne) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:18.367704 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:18.369278 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:18.376371 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 386/772] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 22 20:40:18 2022] GET /identity/v3/endpoints?service_id=506488273f714f52b0059fcc294bf6c2&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:18.383574 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:18.470208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:18.498346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:18.519230 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f24a6-2b2d-4983-98ec-93b79026a761 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:18.558056 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:18.558721 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:18.559004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:18.559364 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:18.560126 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:18.561682 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:18.568227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 387/773] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 22 20:40:18 2022] GET /identity/v3/services => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:40:18.611791 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325316c6-22fa-45ca-9613-85270b1ed249 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:18.661190 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:18.662131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:18.662486 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:18.662951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:18.663962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:18.665430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:18.676564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:18.677731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:18.678668 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 387/774] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 22 20:40:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:18.685403 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:18.816480 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1663c-814e-4a48-add7-0fe90c735aca None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:18.855251 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:18.855838 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:18.856522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:18.856522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:18.857228 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:18.857722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:18.859262 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:18.864780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 388/775] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 22 20:40:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:18.871020 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:18.941747 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:18.991366 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc22d-641a-4a66-8b0c-c4798beebccf None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:19.049855 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:19.050462 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:19.050727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:19.050992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:19.051613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:19.051901 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:19.053364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:19.058892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 388/776] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 22 20:40:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:19.066398 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:19.082901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:19.202028 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd886-89a0-4b3e-a050-b44426fdf450 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:19.241120 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774a83-5960-4b9e-a71c-2c6cec0d8408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:19.241741 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774a83-5960-4b9e-a71c-2c6cec0d8408 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:19.242013 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774a83-5960-4b9e-a71c-2c6cec0d8408 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:19.242280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774a83-5960-4b9e-a71c-2c6cec0d8408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:19.242996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774a83-5960-4b9e-a71c-2c6cec0d8408 None admin] RBAC: Adding query filter params (interface=public, service_id=fd0816cffa7e4f919a480fd0dcc3d549, region_id=RegionOne) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:19.243298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774a83-5960-4b9e-a71c-2c6cec0d8408 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:19.244690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774a83-5960-4b9e-a71c-2c6cec0d8408 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:19.250612 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 389/777] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 22 20:40:19 2022] GET /identity/v3/endpoints?service_id=fd0816cffa7e4f919a480fd0dcc3d549&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:19.257001 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:19.364937 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c62f7-6b8a-4b8d-847a-b1af7df018b5 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:19.388284 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:19.400973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65740-d7f9-46cb-8509-47ff836ae2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:19.401609 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65740-d7f9-46cb-8509-47ff836ae2f4 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:19.401882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65740-d7f9-46cb-8509-47ff836ae2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:19.402140 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65740-d7f9-46cb-8509-47ff836ae2f4 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:19.402792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65740-d7f9-46cb-8509-47ff836ae2f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:19.404194 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65740-d7f9-46cb-8509-47ff836ae2f4 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:19.410366 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 389/778] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 22 20:40:19 2022] GET /identity/v3/services => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:40:20.883074 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19802e8-bc6d-4025-b017-458f6107e1c4 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:20.883615 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19802e8-bc6d-4025-b017-458f6107e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:20.883704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19802e8-bc6d-4025-b017-458f6107e1c4 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:20.885303 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 390/779] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:20.891990 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fa5d5-c2e6-44cd-a2e1-7142f33b4de4 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:20.892483 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fa5d5-c2e6-44cd-a2e1-7142f33b4de4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:20.892566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fa5d5-c2e6-44cd-a2e1-7142f33b4de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:20.911896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-1f7fa5d5-c2e6-44cd-a2e1-7142f33b4de4 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:20.913040 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-1f7fa5d5-c2e6-44cd-a2e1-7142f33b4de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:20.984623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 390/780] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:20 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:21.312402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19802e8-bc6d-4025-b017-458f6107e1c4 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:21.402263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:21.436024 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19802e8-bc6d-4025-b017-458f6107e1c4 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:21.476507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d43c1-6bac-4a6d-8fd2-b9bb65e80d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:21.477772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d43c1-6bac-4a6d-8fd2-b9bb65e80d36 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:21.478273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d43c1-6bac-4a6d-8fd2-b9bb65e80d36 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:21.478772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d43c1-6bac-4a6d-8fd2-b9bb65e80d36 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:21.479824 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d43c1-6bac-4a6d-8fd2-b9bb65e80d36 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:21.482596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d43c1-6bac-4a6d-8fd2-b9bb65e80d36 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-963d43c1-6bac-4a6d-8fd2-b9bb65e80d36 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:21.495859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:21.497323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:21.498361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 391/781] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:21.504443 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fa5d5-c2e6-44cd-a2e1-7142f33b4de4 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:21.614146 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fa5d5-c2e6-44cd-a2e1-7142f33b4de4 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:21.637163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:21.652017 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622519cf-df14-4776-8c83-3ee877f2c81f None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:21.652318 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622519cf-df14-4776-8c83-3ee877f2c81f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:21.652566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622519cf-df14-4776-8c83-3ee877f2c81f None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:21.654606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 392/782] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:21.660617 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519326c-248d-46b0-ad11-72cf0bdb2c91 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:21.660900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519326c-248d-46b0-ad11-72cf0bdb2c91 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:21.661232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519326c-248d-46b0-ad11-72cf0bdb2c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:21.663010 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:21.663634 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:21.663909 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:21.664183 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:21.664818 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:21.665148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:21.666534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:21.671961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 391/783] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:21.678166 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:21.680557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b519326c-248d-46b0-ad11-72cf0bdb2c91 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:21.681992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b519326c-248d-46b0-ad11-72cf0bdb2c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:21.762636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 393/784] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:21 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:21.800387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa8be-c1bf-41f0-94b5-6fa04c363a39 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:21.837363 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:21.837975 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:21.838251 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:21.838519 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:21.839193 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:21.839497 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:21.840884 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:21.846705 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 392/785] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 22 20:40:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:21.853250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519326c-248d-46b0-ad11-72cf0bdb2c91 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:21.931794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:21.967751 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519326c-248d-46b0-ad11-72cf0bdb2c91 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:22.005083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:22.005736 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:22.006360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:22.006634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] PATH_INFO: `/v3/endpoints` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:22.007299 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:22.008685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:22.032353 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 394/786] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:40:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:40:22.105856 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:22.168208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:22.235399 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba5afd-35ed-4999-b009-267b195cb93c None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:22.299183 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:22.299895 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:22.300230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:22.300557 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:22.301279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:22.302759 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:22.312672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:22.314025 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:22.315846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 393/787] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 22 20:40:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:22.320993 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:22.431739 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4e79c-59e5-40cf-8e94-cdaa0d6f661b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:22.479000 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:22.496031 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:22.497413 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:22.500822 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:22.501345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:22.502122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:22.502436 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:22.503871 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:22.509952 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 395/788] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 22 20:40:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:22.517154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:22.640731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cf6c5-95ac-4598-b376-1cf0e5e8b452 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:22.643702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:22.683987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3143-8a16-4beb-a30e-ce75388caeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:22.684614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3143-8a16-4beb-a30e-ce75388caeda None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:22.684897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3143-8a16-4beb-a30e-ce75388caeda None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:22.685199 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3143-8a16-4beb-a30e-ce75388caeda None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:22.685871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3143-8a16-4beb-a30e-ce75388caeda None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:22.686294 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3143-8a16-4beb-a30e-ce75388caeda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:22.687578 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3143-8a16-4beb-a30e-ce75388caeda None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:22.693471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 394/789] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 22 20:40:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:22.699796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:22.820152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bc75e-b0dc-49e2-9e79-97aca03ed2b4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:22.858457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81515f8-21c2-42b4-9468-e8744039153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:22.859070 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81515f8-21c2-42b4-9468-e8744039153d None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:22.859341 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81515f8-21c2-42b4-9468-e8744039153d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:22.859606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81515f8-21c2-42b4-9468-e8744039153d None admin] PATH_INFO: `/v3/endpoints` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:22.860266 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81515f8-21c2-42b4-9468-e8744039153d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:22.861698 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81515f8-21c2-42b4-9468-e8744039153d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:22.886906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 396/790] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:40:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:24.333531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859d9b-22b8-4376-ade8-4a9a08092f39 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:24.334152 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859d9b-22b8-4376-ade8-4a9a08092f39 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:24.334152 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859d9b-22b8-4376-ade8-4a9a08092f39 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:24.335388 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 395/791] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:24.341004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71931-e7ef-41c9-9aad-bd6868da04b8 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:24.341664 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71931-e7ef-41c9-9aad-bd6868da04b8 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:24.341664 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71931-e7ef-41c9-9aad-bd6868da04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:24.361141 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-74b71931-e7ef-41c9-9aad-bd6868da04b8 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:24.362353 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-74b71931-e7ef-41c9-9aad-bd6868da04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:24.408831 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:24.442417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 397/792] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:24 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:24.771344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859d9b-22b8-4376-ade8-4a9a08092f39 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:24.882616 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859d9b-22b8-4376-ade8-4a9a08092f39 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:24.917549 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:24.918159 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:24.918433 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:24.918702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:24.920147 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:24.921666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:24.924389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING keystone.server.flask.common [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 20:40:24.946684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.sql.core [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:40:24.946684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 20:40:24.946684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [parameters: {'id': '437990622329419ab800ab23f980c783', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 20:40:24.946684 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=100161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-cc55ad02-c976-4f95-9a91-d56b34d30707 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 437990622329419ab800ab23f980c783.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 437990622329419ab800ab23f980c783. Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:40:24.963686 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application result.read() Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 20:40:24.965867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application yield resource Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise self.value Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application session.commit() Aug 22 20:40:24.969465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self.session.flush() Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application compat.raise_( Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 20:40:24.972438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 20:40:24.974988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application result.read() Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:40:24.977887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [parameters: {'id': '437990622329419ab800ab23f980c783', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:24.980748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:24.982861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 437990622329419ab800ab23f980c783. Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:24.985036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 396/793] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Aug 22 20:40:24 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:24.986370 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71931-e7ef-41c9-9aad-bd6868da04b8 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:25.098444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71931-e7ef-41c9-9aad-bd6868da04b8 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:25.144113 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:25.144782 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:25.145060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:25.145365 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:25.148765 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3436b2-c155-4c71-af95-67dbf2a1a9a4 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:25.149038 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3436b2-c155-4c71-af95-67dbf2a1a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:25.149349 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3436b2-c155-4c71-af95-67dbf2a1a9a4 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:25.153747 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:25.154846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 397/794] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:40:25.155412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:25.164601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ec5b1-fdc0-4e88-a5cc-fecf0eca59da None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:25.165062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ec5b1-fdc0-4e88-a5cc-fecf0eca59da None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:25.165575 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ec5b1-fdc0-4e88-a5cc-fecf0eca59da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:40:25.167912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:25.169732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:25.170732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 398/795] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:40:25.175539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:25.191223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-e58ec5b1-fdc0-4e88-a5cc-fecf0eca59da None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:25.192849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-e58ec5b1-fdc0-4e88-a5cc-fecf0eca59da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:25.210103 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:25.214051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:25.281119 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 398/796] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:25 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:25.314092 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cd83-c9ae-47b9-8541-7f722b04d0c4 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:25.352334 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:25.353036 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:25.353167 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:25.353402 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:25.354064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:25.354365 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:25.355818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:25.375653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 399/797] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:25.633328 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ec5b1-fdc0-4e88-a5cc-fecf0eca59da None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:25.753080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ec5b1-fdc0-4e88-a5cc-fecf0eca59da None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:25.797580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:25.798230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:25.798508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:25.798779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:25.799375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:25.800922 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:25.810620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:25.811779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:25.812647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 399/798] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:25.818212 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:25.920159 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:25.929967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa344601-e10c-4f6c-8ef8-28dd8c1f30b7 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:25.967782 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5526d4-8c9f-470e-a4aa-85213a91d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:25.968396 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5526d4-8c9f-470e-a4aa-85213a91d007 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:25.968669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5526d4-8c9f-470e-a4aa-85213a91d007 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:25.968936 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5526d4-8c9f-470e-a4aa-85213a91d007 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:25.969602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5526d4-8c9f-470e-a4aa-85213a91d007 None admin] RBAC: Adding query filter params (name=compute) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:25.969901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5526d4-8c9f-470e-a4aa-85213a91d007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:25.971303 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5526d4-8c9f-470e-a4aa-85213a91d007 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:25.976685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 400/799] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:25.982755 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:26.004053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:26.097981 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f408-45c2-4920-a14c-5465302435a2 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:26.141089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a457f7-98da-4cff-8f99-0669a78665b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:26.141779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a457f7-98da-4cff-8f99-0669a78665b9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:26.142055 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a457f7-98da-4cff-8f99-0669a78665b9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:26.142326 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a457f7-98da-4cff-8f99-0669a78665b9 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:26.142986 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a457f7-98da-4cff-8f99-0669a78665b9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:26.143282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a457f7-98da-4cff-8f99-0669a78665b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:26.144718 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a457f7-98da-4cff-8f99-0669a78665b9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:26.150638 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 400/800] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:27.729869 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbffa8-7dc4-4a55-bf0c-da62ce313991 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:27.730774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbffa8-7dc4-4a55-bf0c-da62ce313991 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:27.730774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbffa8-7dc4-4a55-bf0c-da62ce313991 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:27.732539 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 401/801] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:27.738695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9806e-b577-4eb0-9634-477ba393b72c None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:27.739257 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9806e-b577-4eb0-9634-477ba393b72c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:27.739257 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9806e-b577-4eb0-9634-477ba393b72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:27.760699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-64e9806e-b577-4eb0-9634-477ba393b72c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:27.761943 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-64e9806e-b577-4eb0-9634-477ba393b72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:27.836529 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 401/802] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:27 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:28.169595 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbffa8-7dc4-4a55-bf0c-da62ce313991 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:28.278505 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbffa8-7dc4-4a55-bf0c-da62ce313991 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:28.314495 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:28.315101 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:28.315372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:28.315635 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:28.316265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:28.317738 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:28.320261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING keystone.server.flask.common [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 20:40:28.333464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.sql.core [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:40:28.333464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 20:40:28.333464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [parameters: {'user_id': 'c045f79b7df34f6d86bce7ab27f7338c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 20:40:28.333464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=100160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-e395ab94-37af-4cd1-b0d9-075662c914a6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application result.read() Aug 22 20:40:28.351043 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:40:28.352136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application yield resource Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise self.value Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application session.commit() Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 20:40:28.353154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self.session.flush() Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application compat.raise_( Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 20:40:28.354053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:40:28.354976 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application result.read() Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:40:28.355843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c045f79b7df34f6d86bce7ab27f7338c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:28.356800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 20:40:28.357630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 20:40:28.358583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 20:40:28.358583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 20:40:28.358583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 20:40:28.358583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 20:40:28.358583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 20:40:28.358583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:28.358583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 402/803] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 22 20:40:28 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:28.360051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9806e-b577-4eb0-9634-477ba393b72c None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:28.377006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:28.466835 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9806e-b577-4eb0-9634-477ba393b72c None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:28.504937 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:28.505897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:28.506172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:28.506433 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:28.513921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:28.515358 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:40:28.527555 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:28.528873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:28.529862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 402/804] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:40:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:28.534064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7825-6ee7-4ab7-b951-f52ac4338247 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:28.534417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7825-6ee7-4ab7-b951-f52ac4338247 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:28.534654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:28.534885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7825-6ee7-4ab7-b951-f52ac4338247 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:28.539209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 403/805] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:28.545939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841c357-2fe7-4051-9fb8-240296137837 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:28.546223 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841c357-2fe7-4051-9fb8-240296137837 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:28.546609 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841c357-2fe7-4051-9fb8-240296137837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:28.568538 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-0841c357-2fe7-4051-9fb8-240296137837 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:28.570132 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-0841c357-2fe7-4051-9fb8-240296137837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:28.585606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:28.609381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:28.643871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d343-25b5-4512-98db-5d7f87026beb None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:28.655278 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 404/806] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:28.687080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa15ab-5ef0-4047-83a1-fed9b4649f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:28.687762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa15ab-5ef0-4047-83a1-fed9b4649f47 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:28.688233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa15ab-5ef0-4047-83a1-fed9b4649f47 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:28.688506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa15ab-5ef0-4047-83a1-fed9b4649f47 None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:28.689534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa15ab-5ef0-4047-83a1-fed9b4649f47 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:28.689877 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa15ab-5ef0-4047-83a1-fed9b4649f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:28.691692 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa15ab-5ef0-4047-83a1-fed9b4649f47 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:28.730304 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 403/807] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 22 20:40:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:29.013234 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841c357-2fe7-4051-9fb8-240296137837 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:29.120179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841c357-2fe7-4051-9fb8-240296137837 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:29.155489 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891259ad-c403-4146-95d1-4caf4990a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:29.156096 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891259ad-c403-4146-95d1-4caf4990a36d None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:29.156366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891259ad-c403-4146-95d1-4caf4990a36d None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:29.156631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891259ad-c403-4146-95d1-4caf4990a36d None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:29.157305 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891259ad-c403-4146-95d1-4caf4990a36d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:29.158803 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891259ad-c403-4146-95d1-4caf4990a36d None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:29.176018 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 405/808] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:40:29 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:31.407213 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc05f-09f2-4115-b4c3-05df364c777e None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:31.408109 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc05f-09f2-4115-b4c3-05df364c777e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:31.408109 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc05f-09f2-4115-b4c3-05df364c777e None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:31.410384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 404/809] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:31.418506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315920b0-86ea-4c61-bc14-d1ebff79a043 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:31.419019 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315920b0-86ea-4c61-bc14-d1ebff79a043 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:31.419120 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315920b0-86ea-4c61-bc14-d1ebff79a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:31.438702 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-315920b0-86ea-4c61-bc14-d1ebff79a043 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:31.439940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-315920b0-86ea-4c61-bc14-d1ebff79a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:31.442021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:31.519523 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 406/810] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:31 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:40:31.844811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc05f-09f2-4115-b4c3-05df364c777e None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:31.950615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc05f-09f2-4115-b4c3-05df364c777e None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:31.983215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:31.990264 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:31.990900 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:31.991175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:31.991444 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] PATH_INFO: `/v3/services/compute` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:31.992027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:31.993422 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:32.003871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:32.005011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:40:32.006613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 405/811] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:32.011686 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315920b0-86ea-4c61-bc14-d1ebff79a043 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:32.130923 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315920b0-86ea-4c61-bc14-d1ebff79a043 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:32.173009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:32.173668 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:32.173946 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:32.174217 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:32.174851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] RBAC: Adding query filter params (name=compute) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:32.175153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:32.176547 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:32.177951 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:32.183289 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 407/812] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:32.189613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:32.311905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cc6c2-f2d2-4332-b82f-e6a971578a6a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:32.347303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:32.347916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:32.348190 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:32.348458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:32.349136 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] RBAC: Adding query filter params (type=compute) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:32.349464 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:32.350925 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:32.357013 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 406/813] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:32.364054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:32.478187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8154f27-5d8c-43e7-ae7d-2ca1f753a8dc None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:32.518287 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1400102-450d-4bad-bc5a-0019e1902e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:32.519063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400102-450d-4bad-bc5a-0019e1902e10 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:32.519380 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400102-450d-4bad-bc5a-0019e1902e10 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:32.519646 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400102-450d-4bad-bc5a-0019e1902e10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:32.520794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1400102-450d-4bad-bc5a-0019e1902e10 None admin] RBAC: Adding query filter params (interface=public, service_id=08de93a1f0364e4daacc76354c998614, region_id=RegionOne) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:32.521199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1400102-450d-4bad-bc5a-0019e1902e10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:32.522670 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1400102-450d-4bad-bc5a-0019e1902e10 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:32.528877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 408/814] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 22 20:40:32 2022] GET /identity/v3/endpoints?service_id=08de93a1f0364e4daacc76354c998614&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:32.534811 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:32.596899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:32.645642 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758776-8e8c-4ee4-af2e-9816e86ee067 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:32.684070 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408c32f-adf1-48bc-a5e2-9c6353f4a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:32.684871 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c32f-adf1-48bc-a5e2-9c6353f4a95e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:32.685250 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c32f-adf1-48bc-a5e2-9c6353f4a95e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:32.685566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c32f-adf1-48bc-a5e2-9c6353f4a95e None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:32.686240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408c32f-adf1-48bc-a5e2-9c6353f4a95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:32.687729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408c32f-adf1-48bc-a5e2-9c6353f4a95e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:32.694851 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 407/815] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 22 20:40:32 2022] GET /identity/v3/services => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:40:34.978825 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2b80-8d04-429c-a292-74a454fb403c None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:34.979387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2b80-8d04-429c-a292-74a454fb403c None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:34.979387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2b80-8d04-429c-a292-74a454fb403c None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:34.980695 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 409/816] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:40:34.990006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769f1c-5f2d-433b-a98a-a0de678d5471 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:34.990634 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769f1c-5f2d-433b-a98a-a0de678d5471 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:34.990634 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769f1c-5f2d-433b-a98a-a0de678d5471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:35.010775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-dd769f1c-5f2d-433b-a98a-a0de678d5471 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:40:35.012022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-dd769f1c-5f2d-433b-a98a-a0de678d5471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:40:35.088060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 408/817] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:40:34 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:40:35.424563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c2b80-8d04-429c-a292-74a454fb403c None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:35.502525 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:35.547380 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c2b80-8d04-429c-a292-74a454fb403c None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:35.587223 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:35.587847 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:35.588119 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:35.588383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] PATH_INFO: `/v3/services/compute` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:35.588970 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:35.590478 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:40:35.599487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:40:35.600653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:40:35.601967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 410/818] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:40:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:40:35.606840 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd769f1c-5f2d-433b-a98a-a0de678d5471 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:35.665944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:35.720642 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd769f1c-5f2d-433b-a98a-a0de678d5471 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:35.760641 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:35.761143 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:35.761441 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:35.761711 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:35.762310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:35.762627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:35.764096 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:35.771387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 409/819] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:40:35.777508 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:35.890332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d42b-1741-4e2d-b730-851a8dfe352b None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:35.917688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:35.928567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127e6ac-6b75-4673-a845-5d2b2bd62d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:35.929198 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127e6ac-6b75-4673-a845-5d2b2bd62d8e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:35.929470 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127e6ac-6b75-4673-a845-5d2b2bd62d8e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:35.929731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127e6ac-6b75-4673-a845-5d2b2bd62d8e None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:35.930507 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127e6ac-6b75-4673-a845-5d2b2bd62d8e None admin] RBAC: Adding query filter params (type=compute) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:40:35.930771 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127e6ac-6b75-4673-a845-5d2b2bd62d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:35.932182 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127e6ac-6b75-4673-a845-5d2b2bd62d8e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:35.938265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 411/820] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 22 20:40:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:40:35.944416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:40:36.053371 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c958d-54c4-411d-a022-19a1f835eac7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:40:36.072133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:36.092449 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daec853-7eb3-4366-970f-5c07a35e9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:40:36.093049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daec853-7eb3-4366-970f-5c07a35e9c3e None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:40:36.093356 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daec853-7eb3-4366-970f-5c07a35e9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:40:36.093622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daec853-7eb3-4366-970f-5c07a35e9c3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:40:36.094277 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daec853-7eb3-4366-970f-5c07a35e9c3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:40:36.095636 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daec853-7eb3-4366-970f-5c07a35e9c3e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:40:36.117726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 410/821] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:40:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:40:45.935211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=5 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:46.112677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=13,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:40.844296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcd4ae-f0b0-421f-8e9d-82f148293e25 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:40.845034 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcd4ae-f0b0-421f-8e9d-82f148293e25 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:40.845034 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcd4ae-f0b0-421f-8e9d-82f148293e25 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:40.846435 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 412/822] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:40.852580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3181-6fa2-4592-b79d-cfa2a03d5ac1 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:40.853357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3181-6fa2-4592-b79d-cfa2a03d5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:40.853357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3181-6fa2-4592-b79d-cfa2a03d5ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:40.874673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-4ecc3181-6fa2-4592-b79d-cfa2a03d5ac1 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:40.875954 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-4ecc3181-6fa2-4592-b79d-cfa2a03d5ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:40.994918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 411/823] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:41:41.332747 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcd4ae-f0b0-421f-8e9d-82f148293e25 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:41.508619 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcd4ae-f0b0-421f-8e9d-82f148293e25 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:41.566331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:41.567524 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:41.568079 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:41.568549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:41.584338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:41.585942 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:41:41.602583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:41.603924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:41:41.605038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:41:41.605038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:41.605038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:41:41.609708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 413/824] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:41.611421 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc3181-6fa2-4592-b79d-cfa2a03d5ac1 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:41.763511 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc3181-6fa2-4592-b79d-cfa2a03d5ac1 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:41.804150 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:41.822047 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595b1d-01ab-408a-9c63-5759d1c0e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:41.822932 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595b1d-01ab-408a-9c63-5759d1c0e823 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:41.823494 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595b1d-01ab-408a-9c63-5759d1c0e823 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:41.823957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595b1d-01ab-408a-9c63-5759d1c0e823 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:41.825343 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595b1d-01ab-408a-9c63-5759d1c0e823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:41.825898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595b1d-01ab-408a-9c63-5759d1c0e823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:41.828093 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595b1d-01ab-408a-9c63-5759d1c0e823 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:41.852921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 412/825] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:41.854644 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:41.930392 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:41.987896 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338106d-59ba-477f-be45-40014ef0719c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:42.032882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a7553-5317-43f4-b70b-27e9f2b980c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:42.033457 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a7553-5317-43f4-b70b-27e9f2b980c4 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:42.033808 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a7553-5317-43f4-b70b-27e9f2b980c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:42.034163 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a7553-5317-43f4-b70b-27e9f2b980c4 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:42.035291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a7553-5317-43f4-b70b-27e9f2b980c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:42.036631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a7553-5317-43f4-b70b-27e9f2b980c4 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:42.068049 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 414/826] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 22 20:41:41 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:41:44.396236 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633ad9-a05a-46f7-8944-755af1093415 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:44.396816 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633ad9-a05a-46f7-8944-755af1093415 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:44.396960 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633ad9-a05a-46f7-8944-755af1093415 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:44.398553 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 413/827] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:44.408878 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f326-a12e-4735-8635-c580e7455135 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:44.409528 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f326-a12e-4735-8635-c580e7455135 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:44.409634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f326-a12e-4735-8635-c580e7455135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:44.431496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-fb12f326-a12e-4735-8635-c580e7455135 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:44.432717 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-fb12f326-a12e-4735-8635-c580e7455135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:44.512853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 415/828] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:41:44.859169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633ad9-a05a-46f7-8944-755af1093415 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:45.001301 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633ad9-a05a-46f7-8944-755af1093415 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:45.045724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f39eba-f865-4125-b675-223d92126219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:45.046462 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f39eba-f865-4125-b675-223d92126219 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:45.046699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f39eba-f865-4125-b675-223d92126219 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:45.046973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f39eba-f865-4125-b675-223d92126219 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:45.061322 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f39eba-f865-4125-b675-223d92126219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-94f39eba-f865-4125-b675-223d92126219 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:41:45.066012 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:45.067078 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:45.067955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 414/829] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:41:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:45.074461 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f326-a12e-4735-8635-c580e7455135 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:45.129239 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:45.198557 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f326-a12e-4735-8635-c580e7455135 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:45.243935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:45.244610 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:45.244894 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:45.245178 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:45.245851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:45.246290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:45.247851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:45.258124 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 416/830] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:41:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:45.264996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f39eba-f865-4125-b675-223d92126219 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:45.326100 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:45.410003 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f39eba-f865-4125-b675-223d92126219 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:45.459117 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:45.459825 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:45.460081 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:45.460344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:45.472728 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:45.474533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:41:45.493821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:45.495121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:41:45.496495 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:41:45.496495 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:45.496495 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:45.496495 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 415/831] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:45.502004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:45.623448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:45.626842 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b55f7-b31b-47c4-b37b-a4f775f3111c None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:45.670545 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:45.671403 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:45.671806 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:45.672219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:45.673302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:45.673777 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:45.675902 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:45.696944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 417/832] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:45.704905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:45.854856 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:45.860209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c802c2-07f2-4704-9044-e7bbf267af01 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:45.907506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:45.908266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:45.908747 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:45.908903 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:45.918476 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:45.920111 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:41:45.937726 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:45.942101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:41:45.943272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:45.943924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 416/833] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:45.944964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:46.068271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d486-909e-429e-b93f-90dcaa3dc97f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:46.106969 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:46.107661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:46.107958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:46.108201 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:46.109144 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:46.109688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:46.111207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:46.130670 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 418/834] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 22 20:41:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:46.138544 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:46.275408 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca2657-2380-417d-a171-22179a4930c1 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:46.317861 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:46.318497 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:46.319045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:46.319045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:46.351859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:46.413870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:46.416074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:46.571497 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 417/835] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:41:46 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:41:46.578273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:46.600904 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:46.693407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66621-5056-4122-b4f0-99d6de7a4145 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:46.740782 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:46.741506 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:46.741783 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:46.742093 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:46.753563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:46.755069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:41:46.771154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:46.777692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:41:46.778773 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:41:46.778773 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:46.778773 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:41:46.778773 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 419/836] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:46.779163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:46.841303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:46.886282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2549-2c40-4383-9368-933f9a4b580a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:46.925052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:46.925707 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:46.925984 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:46.926191 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:46.926854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:46.927170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:46.928531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:46.941962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 418/837] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:46.947916 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:47.026997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:47.065707 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae7bc9-14ae-4e5d-9f9c-4d5e8221a178 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:47.101114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:47.101886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:47.102273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:47.102636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:47.110438 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:47.111962 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:41:47.124240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:47.125950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:41:47.127357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 420/838] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:41:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:47.132508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:47.253543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202198c-6382-4e47-99f2-132b5c4692cd None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:47.272600 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:47.291913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3d996-4467-4817-b722-9edc4717ba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:47.292570 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d996-4467-4817-b722-9edc4717ba14 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:47.292851 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d996-4467-4817-b722-9edc4717ba14 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:47.293545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d996-4467-4817-b722-9edc4717ba14 None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:47.294318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3d996-4467-4817-b722-9edc4717ba14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:47.294630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3d996-4467-4817-b722-9edc4717ba14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:47.296074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3d996-4467-4817-b722-9edc4717ba14 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:47.310004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 419/839] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:41:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:47.316560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:47.449488 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248738b2-3345-49c9-b84e-da1f0f1f204f None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:47.483464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:47.489863 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2201a5-d818-4346-837d-bf8979d5ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:47.490523 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2201a5-d818-4346-837d-bf8979d5ec49 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:47.490794 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2201a5-d818-4346-837d-bf8979d5ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:47.491057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2201a5-d818-4346-837d-bf8979d5ec49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:47.491777 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2201a5-d818-4346-837d-bf8979d5ec49 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=48a5ba0a3da749309b1c514b13a3141b) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:47.492098 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2201a5-d818-4346-837d-bf8979d5ec49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:47.493563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2201a5-d818-4346-837d-bf8979d5ec49 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:47.499597 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 421/840] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:41:47 2022] GET /identity/v3/role_assignments?user.id=48a5ba0a3da749309b1c514b13a3141b&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:49.810319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5a726-b8c9-476a-a4dd-b3603df287aa None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:49.810902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5a726-b8c9-476a-a4dd-b3603df287aa None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:49.810902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5a726-b8c9-476a-a4dd-b3603df287aa None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:49.812414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 420/841] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:49.818468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede598-6b0d-46d4-9bc6-581386435c57 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:49.818967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede598-6b0d-46d4-9bc6-581386435c57 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:49.819046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede598-6b0d-46d4-9bc6-581386435c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:49.838196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-d8ede598-6b0d-46d4-9bc6-581386435c57 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:49.839385 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-d8ede598-6b0d-46d4-9bc6-581386435c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:49.909073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 422/842] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:41:50.255821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5a726-b8c9-476a-a4dd-b3603df287aa None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:50.368032 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5a726-b8c9-476a-a4dd-b3603df287aa None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:50.409601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:50.410235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:50.410511 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:50.410781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:50.422529 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:41:50.427675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:50.428885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:50.429770 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 421/843] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:50.435574 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ede598-6b0d-46d4-9bc6-581386435c57 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:50.552963 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ede598-6b0d-46d4-9bc6-581386435c57 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:50.582641 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:50.596427 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:50.597035 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:50.597346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:50.597606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:50.598261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] RBAC: Adding query filter params (name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:50.598555 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:50.599933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:50.608862 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 423/844] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:41:50.614962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:50.667385 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:50.752687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd2f6-0359-4ee8-b9cc-84bd73ac37a3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:50.803786 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:50.804362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:50.804614 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:50.804888 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:50.816647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:50.818158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:41:50.834181 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:50.835534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:41:50.836431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:41:50.836431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:50.836431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:50.836431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 422/845] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:50.841901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:50.980218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5e838-596b-428d-a899-b10c78bb6597 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:51.022932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:51.023826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:51.024102 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:51.024440 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:51.025254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:51.025559 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:51.027490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:51.046919 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 424/846] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:51.054466 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:51.180171 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:51.192727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e05e-88af-413a-805d-e52a753db8e4 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:51.236639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:51.236639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:51.236639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:51.236639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:51.246074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:51.247792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:41:51.261164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:51.262930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:51.263916 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 423/847] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:51.268678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:51.318772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:51.376400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb007f1d-f693-4887-ae82-5a1240053b81 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:51.414191 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:51.414896 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:51.415273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:51.415554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:51.416547 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:51.417052 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:51.418791 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:51.444519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 425/848] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 22 20:41:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:51.453349 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:51.574218 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074615bf-0a9b-4a4d-918b-dce9d34909f0 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:51.608880 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:51.609531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:51.609817 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:51.610068 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:51.621001 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:51.622602 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:41:51.637891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:51.639103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:41:51.639994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:41:51.639994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:51.639994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:51.639994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 424/849] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:41:51.645650 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:51.780251 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433f3b-b0d3-4b0e-938b-e52ad4338ad8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:51.782988 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:51.822096 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:51.822715 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:51.822991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:51.823262 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:51.823912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:51.824366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:51.826017 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:51.838630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 426/850] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:51.845166 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:51.853846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:51.975634 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58021666-ceed-4839-90e1-147951938bc5 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:52.015173 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:52.015840 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:52.016161 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:52.016467 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:52.024474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:52.026099 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:41:52.037962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:52.039185 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:52.040110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 425/851] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:41:52.045316 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:52.182288 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db29213-279f-404e-a34a-15465a062e15 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:52.219613 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80d07-46cb-4615-85ff-2aebb3c9f66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:52.220207 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80d07-46cb-4615-85ff-2aebb3c9f66b None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:52.220477 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80d07-46cb-4615-85ff-2aebb3c9f66b None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:52.220741 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80d07-46cb-4615-85ff-2aebb3c9f66b None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:52.221683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80d07-46cb-4615-85ff-2aebb3c9f66b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:52.221906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80d07-46cb-4615-85ff-2aebb3c9f66b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:52.223326 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80d07-46cb-4615-85ff-2aebb3c9f66b None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:52.241146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 427/852] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:52.243123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:52.310273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:52.352874 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21781a98-c986-4826-bc01-d959be26e3a9 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:52.390787 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083b11e-4865-4d97-b7a8-83200535b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:52.391448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b11e-4865-4d97-b7a8-83200535b56c None admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:52.391720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b11e-4865-4d97-b7a8-83200535b56c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:52.392017 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b11e-4865-4d97-b7a8-83200535b56c None admin] PATH_INFO: `/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/48a5ba0a3da749309b1c514b13a3141b/roles/5f672af6c905476c8fda8af9d08d714c` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:52.407452 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b11e-4865-4d97-b7a8-83200535b56c None admin] RBAC: Authorizing `identity:create_grant(project_id=b23a3011ea504944be8e0d8f3394d7df, user_id=48a5ba0a3da749309b1c514b13a3141b, role_id=5f672af6c905476c8fda8af9d08d714c)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:52.409362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b11e-4865-4d97-b7a8-83200535b56c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:52.424973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 426/853] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:41:52 2022] PUT /identity/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/48a5ba0a3da749309b1c514b13a3141b/roles/5f672af6c905476c8fda8af9d08d714c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:41:54.996827 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955312-ec0d-4edc-9efa-114cfb76868d None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:54.997560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955312-ec0d-4edc-9efa-114cfb76868d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:54.997560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955312-ec0d-4edc-9efa-114cfb76868d None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:54.999233 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 428/854] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:55.007708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae0ee-0360-4b70-8b89-d1aa401f903a None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:55.008510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae0ee-0360-4b70-8b89-d1aa401f903a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:55.008510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae0ee-0360-4b70-8b89-d1aa401f903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:55.030931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-fa9ae0ee-0360-4b70-8b89-d1aa401f903a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:55.032167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-fa9ae0ee-0360-4b70-8b89-d1aa401f903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:55.117894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 427/855] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:41:55.455610 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955312-ec0d-4edc-9efa-114cfb76868d None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:55.490323 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:55.579092 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955312-ec0d-4edc-9efa-114cfb76868d None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:55.616193 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:55.616842 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:55.617150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:55.617421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:55.629411 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:41:55.634933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:55.636084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:41:55.637372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 429/856] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 22 20:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:55.642933 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae0ee-0360-4b70-8b89-d1aa401f903a None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:55.701246 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:55.778409 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae0ee-0360-4b70-8b89-d1aa401f903a None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:55.817510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:55.818126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:55.818406 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:55.818678 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:55.819355 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] RBAC: Adding query filter params (name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:55.819658 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:55.821046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:55.830508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 428/857] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 22 20:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:55.837327 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:55.937270 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:55.954274 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d0856-6e0b-4959-86dc-dfb110cefad8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:55.989835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:55.990475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:55.990797 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:55.991153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:56.003194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:56.004932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:41:56.021496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:56.022669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:41:56.029183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:41:56.029183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:56.029183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:41:56.029183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 430/858] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:56.030463 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:56.139786 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7336baa-b786-4eb0-8ab3-b3df8e95fe07 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:56.142310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:56.178027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:56.178643 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:56.178918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:56.179188 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:56.179833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:56.180133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:56.181604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:56.195552 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 429/859] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:56.203014 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:56.322613 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b9aad-cbb7-470e-a111-0a40e940ca01 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:56.361649 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:56.362731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:56.363188 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:56.363718 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:56.368005 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:56.377152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:56.378342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:41:56.390621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:56.391690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:41:56.393796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 431/860] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:41:56.397901 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:56.520261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004118b-d795-48f0-a8c3-638926cb0638 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:56.567122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:56.567758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:56.568032 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:56.568297 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:56.569050 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:56.569375 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:56.570877 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:56.590591 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 430/861] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 22 20:41:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:56.598054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:56.732140 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be6cf-753a-4340-894b-6277fb7375a0 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:56.779456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:56.780072 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:56.780350 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:56.780648 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:56.853351 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:56.869343 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:56.871085 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:56.990179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 432/862] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:41:56 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:41:56.998253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:57.029036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:57.122224 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039f80-07fb-4a84-bb1d-448da0bd95e3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:57.161080 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:57.162035 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:57.162235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:57.162500 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:57.176480 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:57.178107 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:41:57.196902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:57.203315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:41:57.204404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:41:57.204404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:41:57.204404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:57.204404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 431/863] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:57.204652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:57.318263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:57.326265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e109e-3baa-4a43-8cbf-80cb5e83a7eb None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:57.362938 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:57.363525 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:57.363796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:57.364057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:57.364724 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:57.365027 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:57.366478 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:57.378381 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 433/864] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:41:57.387839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:57.484053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:57.515420 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e175-c4a7-4bc0-98a2-727788ec4edb None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:57.561827 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:57.562768 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:57.563157 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:57.563460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:57.571706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:57.573471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:41:57.586859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:41:57.588956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:41:57.590917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 432/865] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:41:57.595605 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:57.752299 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffa71-99d4-4683-9b8b-d4812783d933 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:57.790138 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29167c9-1dc1-4660-9dc8-a79b2bade0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:57.790743 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29167c9-1dc1-4660-9dc8-a79b2bade0c6 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:57.791011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29167c9-1dc1-4660-9dc8-a79b2bade0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:57.791281 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29167c9-1dc1-4660-9dc8-a79b2bade0c6 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:57.791959 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29167c9-1dc1-4660-9dc8-a79b2bade0c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:57.792259 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29167c9-1dc1-4660-9dc8-a79b2bade0c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:57.794239 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29167c9-1dc1-4660-9dc8-a79b2bade0c6 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:57.808752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 434/866] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:41:57.816028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:57.944006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20468-e473-415a-98f6-29c25a8cee64 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:57.993978 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b2061-c258-4a76-b2fa-d38e35139825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:57.994964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2061-c258-4a76-b2fa-d38e35139825 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:57.995458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2061-c258-4a76-b2fa-d38e35139825 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:57.996028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2061-c258-4a76-b2fa-d38e35139825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:57.997532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b2061-c258-4a76-b2fa-d38e35139825 None admin] RBAC: Adding query filter params (role.id=5f672af6c905476c8fda8af9d08d714c, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=48a5ba0a3da749309b1c514b13a3141b) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:57.998087 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b2061-c258-4a76-b2fa-d38e35139825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:58.000943 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b2061-c258-4a76-b2fa-d38e35139825 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:58.004548 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:58.013615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 433/867] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:41:57 2022] GET /identity/v3/role_assignments?user.id=48a5ba0a3da749309b1c514b13a3141b&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5f672af6c905476c8fda8af9d08d714c => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:42:00.514196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d571864-f5b8-4cf4-90a3-cadce3ccfd26 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:00.514943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d571864-f5b8-4cf4-90a3-cadce3ccfd26 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:00.514943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d571864-f5b8-4cf4-90a3-cadce3ccfd26 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:00.516038 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 435/868] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:42:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:00.524590 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7575-bbac-42cf-9324-1ec1fa0841c3 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:00.525312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7575-bbac-42cf-9324-1ec1fa0841c3 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:00.525312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7575-bbac-42cf-9324-1ec1fa0841c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:00.545153 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-a07e7575-bbac-42cf-9324-1ec1fa0841c3 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:00.546552 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-a07e7575-bbac-42cf-9324-1ec1fa0841c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:00.634259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 434/869] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:00 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:42:00.965485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d571864-f5b8-4cf4-90a3-cadce3ccfd26 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:00.985032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:01.123895 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d571864-f5b8-4cf4-90a3-cadce3ccfd26 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:01.173839 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:01.174842 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:01.175279 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:01.175702 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:01.189591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:42:01.194513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:01.195940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:01.196912 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 436/870] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:01.202549 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7575-bbac-42cf-9324-1ec1fa0841c3 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:01.322134 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7575-bbac-42cf-9324-1ec1fa0841c3 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:01.353540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:01.362633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:01.363384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:01.363750 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:01.364261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:01.364943 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:01.365345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:01.366695 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:01.376421 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 435/871] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:01.383203 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:01.479473 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:01.508387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feede66-ca99-4ba6-a200-9324496ac4a3 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:01.553342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:01.553342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:01.554258 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:01.554258 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:01.571147 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:01.574253 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:42:01.594760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:01.595974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:42:01.597040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:42:01.597040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:01.597040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:01.597040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 437/872] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:01.602714 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:01.725716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16451ef-338d-4f78-ac62-afea64a6dcf3 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:01.766350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:01.766921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:01.767196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:01.767459 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:01.768102 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:01.768392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:01.769791 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:01.782417 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 436/873] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:01.788520 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:01.897521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd040f-1330-42f2-805c-9d1daeed6a8e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:01.932186 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:01.941285 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:01.942037 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:01.942338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:01.942617 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] PATH_INFO: `/v3/users/placement` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:01.952134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:01.953829 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:42:01.967603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:01.968900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:01.970063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 438/874] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:01.975319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:02.032166 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:02.105566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8a124-fad3-4bc8-bc68-443b0e790cd7 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:02.148338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:02.148948 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:02.149254 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:02.149518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:02.150339 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:02.150689 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:02.152261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:02.172803 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 437/875] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 22 20:42:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:42:02.178490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:02.299100 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b2a3-6719-4e5f-9b10-c5c87867966a None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:02.338653 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:02.339372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:02.339709 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:02.340060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:02.401827 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:02.417319 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:02.419006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:02.535735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 439/876] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:42:02 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:42:02.542148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:02.659036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189af9-166e-4c5c-9899-e423d275886e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:02.675153 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:02.707772 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:02.708438 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:02.708736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:02.708992 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:02.721249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:02.722970 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:42:02.740310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:02.742629 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:42:02.744673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:42:02.744673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:02.744673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:02.744673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 438/877] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:02.749226 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:02.852769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:02.867644 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9925ced-59c8-4eff-af83-8256af6b8837 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:02.906319 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:02.906943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:02.907218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:02.907485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:02.908134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:02.908433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:02.909908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:02.923009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 440/878] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:42:02.929365 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:03.051646 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b144-ffe5-4bf5-bfee-fd94b46a2e03 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:03.089564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:03.090240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:03.090520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:03.090900 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] PATH_INFO: `/v3/projects/service` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:03.098510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:03.099977 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:42:03.112698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:03.113849 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:03.115253 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 439/879] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:03.120057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:03.231953 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d04f3-c164-4c58-a3b5-7c9e33052b50 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:03.272173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019e574-21e8-4c9c-a699-da6241d57882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:03.272789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019e574-21e8-4c9c-a699-da6241d57882 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:03.273063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019e574-21e8-4c9c-a699-da6241d57882 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:03.273494 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019e574-21e8-4c9c-a699-da6241d57882 None admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:03.274188 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019e574-21e8-4c9c-a699-da6241d57882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:03.274485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019e574-21e8-4c9c-a699-da6241d57882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:03.275965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019e574-21e8-4c9c-a699-da6241d57882 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:03.291944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 441/880] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:03.298734 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:03.324084 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:03.422028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4716f43-d6dc-43d6-8e9d-531a9197021a None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:03.458573 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67ffd9-39b7-45c2-bdf4-ed8f1c4206dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:03.458790 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ffd9-39b7-45c2-bdf4-ed8f1c4206dd None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:03.459023 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ffd9-39b7-45c2-bdf4-ed8f1c4206dd None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:03.459296 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ffd9-39b7-45c2-bdf4-ed8f1c4206dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:03.460007 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ffd9-39b7-45c2-bdf4-ed8f1c4206dd None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=48a5ba0a3da749309b1c514b13a3141b) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:03.460321 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ffd9-39b7-45c2-bdf4-ed8f1c4206dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:03.462011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ffd9-39b7-45c2-bdf4-ed8f1c4206dd None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:03.468562 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 440/881] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:42:03 2022] GET /identity/v3/role_assignments?user.id=48a5ba0a3da749309b1c514b13a3141b&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:42:05.704385 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ace1d-d7f2-41ad-933b-5590e963931c None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:05.705355 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ace1d-d7f2-41ad-933b-5590e963931c None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:05.705355 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ace1d-d7f2-41ad-933b-5590e963931c None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:05.706697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 442/882] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:05.712955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c251f-ae17-40d6-b378-77af752d6345 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:05.713753 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c251f-ae17-40d6-b378-77af752d6345 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:05.713931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c251f-ae17-40d6-b378-77af752d6345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:05.746089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-ed7c251f-ae17-40d6-b378-77af752d6345 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:05.747961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-ed7c251f-ae17-40d6-b378-77af752d6345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:05.832687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 441/883] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:05 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:42:06.162891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ace1d-d7f2-41ad-933b-5590e963931c None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:06.178400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:06.294346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ace1d-d7f2-41ad-933b-5590e963931c None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:06.336588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:06.337241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:06.337515 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:06.337783 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:06.349554 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:42:06.354249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:06.355425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:06.356486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 443/884] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:06.363245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c251f-ae17-40d6-b378-77af752d6345 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:06.383419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:06.479506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c251f-ae17-40d6-b378-77af752d6345 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:06.520773 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:06.521414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:06.521687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:06.521944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:06.522611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:06.522911 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:06.524324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:06.533201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 442/885] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:06.539446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:06.607359 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:06.643632 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657719-cfa5-45b2-b8a6-56feeca172ea None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:06.681710 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:06.682332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:06.682604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:06.682866 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:06.695231 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:06.696757 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:42:06.714426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:06.716383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:42:06.717382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:42:06.717382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:06.717382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:06.717382 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 444/886] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:06.722373 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:06.806753 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:06.839842 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38d14-f47b-4768-80ee-ca76072d7684 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:06.877197 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:06.877793 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:06.878064 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:06.878324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:06.878957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:06.879282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:06.880637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:06.892808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 443/887] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:42:06.899114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:07.012363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca6dcf-1a97-4ed2-830c-7ec25d1fa2f8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:07.033877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:07.049241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:07.049857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:07.050129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:07.050395 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:07.057982 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:07.059940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:42:07.071150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:07.077875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:07.079358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 445/888] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:07.080540 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:07.184460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039063e-8620-4450-9a87-837275bcb098 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:07.218533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:07.219116 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:07.219388 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:07.219667 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:07.220458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:07.220762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:07.222293 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:07.224835 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:07.241514 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 444/889] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 22 20:42:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:07.247943 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:07.360799 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f4a24-c4c3-4741-aebf-e771a0c88201 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:07.402575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:07.403872 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:07.404206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:07.404476 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:07.416156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:07.417674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:42:07.433218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:07.434443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:42:07.435696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:42:07.435696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:07.435696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:07.435696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 446/890] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:07.441055 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:07.553851 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20349a-a40c-4716-80cd-73ee52b8eb0c None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:07.592379 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:07.593024 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:07.593361 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:07.593655 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:07.594400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:07.594704 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:07.596089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:07.608227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 445/891] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:07.614364 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:07.652345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:07.739032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f6cd9-89d1-47ef-b6c1-c6c0a2c6d3a8 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:07.778935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:07.779571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:07.779841 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:07.780108 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:07.787265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:07.788875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:42:07.800153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:07.801280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:07.802817 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 447/892] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:07.809955 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:07.871850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:07.922586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b32ee-4f7d-43fa-9b00-ab3d94cf247b None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:07.958200 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8f9ce-9fbe-429d-9bdd-89676b2f8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:07.958809 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f9ce-9fbe-429d-9bdd-89676b2f8042 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:07.959094 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f9ce-9fbe-429d-9bdd-89676b2f8042 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:07.959345 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f9ce-9fbe-429d-9bdd-89676b2f8042 None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:07.960014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8f9ce-9fbe-429d-9bdd-89676b2f8042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:07.960316 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8f9ce-9fbe-429d-9bdd-89676b2f8042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:07.961781 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8f9ce-9fbe-429d-9bdd-89676b2f8042 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:07.976865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 446/893] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:07.986000 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:08.099250 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:08.110011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b551a-062f-416d-815e-71419c7b9936 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:08.144194 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb1b9e-afa1-428d-b840-33ae14b50332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:08.144751 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1b9e-afa1-428d-b840-33ae14b50332 None admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:08.145023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1b9e-afa1-428d-b840-33ae14b50332 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:08.145321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1b9e-afa1-428d-b840-33ae14b50332 None admin] PATH_INFO: `/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/48a5ba0a3da749309b1c514b13a3141b/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:08.147218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb1b9e-afa1-428d-b840-33ae14b50332 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23a3011ea504944be8e0d8f3394d7df, user_id=48a5ba0a3da749309b1c514b13a3141b, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:08.148637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb1b9e-afa1-428d-b840-33ae14b50332 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:08.167204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 448/894] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 22 20:42:07 2022] PUT /identity/v3/projects/b23a3011ea504944be8e0d8f3394d7df/users/48a5ba0a3da749309b1c514b13a3141b/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:42:10.341922 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7947ee-0a27-42cd-923a-05bb447423b1 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:10.342839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7947ee-0a27-42cd-923a-05bb447423b1 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:10.342839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7947ee-0a27-42cd-923a-05bb447423b1 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:10.346069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 447/895] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:42:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:10.352711 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb46d2-bd1f-4432-ada7-316123a0fa05 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:10.353209 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb46d2-bd1f-4432-ada7-316123a0fa05 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:10.353309 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb46d2-bd1f-4432-ada7-316123a0fa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:10.373853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-71cb46d2-bd1f-4432-ada7-316123a0fa05 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:10.375028 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-71cb46d2-bd1f-4432-ada7-316123a0fa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:10.451828 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 449/896] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:42:10.776677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7947ee-0a27-42cd-923a-05bb447423b1 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:10.890903 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7947ee-0a27-42cd-923a-05bb447423b1 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:10.905889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:10.928143 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:10.928768 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:10.929039 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:10.929336 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:10.940022 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:42:10.944722 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:10.949266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:10.951858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 448/897] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 22 20:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:10.955588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb46d2-bd1f-4432-ada7-316123a0fa05 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:11.050263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:11.071752 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb46d2-bd1f-4432-ada7-316123a0fa05 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:11.109673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:11.110268 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:11.110537 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:11.110801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:11.111454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:11.111745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:11.113131 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:11.121154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 450/898] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 22 20:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:11.127346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:11.231519 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666931-1eda-4d3d-b680-35ccf85e5524 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:11.267266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:11.267876 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:11.268466 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:11.268466 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:11.279485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:11.280954 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:42:11.296969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:11.298037 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:42:11.298993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:42:11.298993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:11.298993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:11.298993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 449/899] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:11.304285 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:11.410362 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408abd-abcf-46a3-a2fb-b6df70b0ed06 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:11.450077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:11.450671 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:11.450942 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:11.451205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:11.451832 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:11.452131 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:11.453511 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:11.465470 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 451/900] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:11.471420 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:11.504485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:11.597265 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29af566-2d81-4fa5-b696-0c18ee4f9722 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:11.632759 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:11.633402 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:11.633675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:11.633935 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] PATH_INFO: `/v3/users/placement` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:11.641582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:11.643004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:42:11.654120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:11.655205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:11.656158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 450/901] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:11.663366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:11.669902 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:11.778762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48abc28-c4e1-4762-af42-6c94f9935960 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:11.815320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:11.815925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:11.816208 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:11.816467 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:11.817220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:11.817529 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:11.818952 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:11.836730 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 452/902] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 22 20:42:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:11.843487 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:11.940994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:11.956223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ea41c-7b67-4636-b376-abf7a1e1c97d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:11.994579 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:11.995176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:11.995448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:11.995719 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:12.075294 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:12.076995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:12.176303 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:12.193852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 451/903] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 22 20:42:11 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:42:12.200122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:12.274173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:12.314853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6a870-5652-435a-8bfd-37a9056006c9 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:12.353042 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:12.353693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:12.353967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:12.354196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:12.365408 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:12.366835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:42:12.386366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:12.387581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:42:12.388683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:42:12.388683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:42:12.388683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:12.388683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 453/904] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:12.395162 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:12.500568 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b280-054e-42c2-ab9c-9d58390f2eb8 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:12.539961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:12.540565 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:12.540835 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:12.541118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:12.541765 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:12.542062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:12.543430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:12.554782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 452/905] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 22 20:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:12.564596 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:12.687678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e2c6-da3b-4008-8140-4b4744ef1f11 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:12.702785 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:12.730762 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:12.731375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:12.731669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:12.731901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:12.739574 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:12.741013 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:42:12.753360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:12.754400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: ERROR keystone.server.flask.application Aug 22 20:42:12.755282 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 454/906] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 22 20:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:12.761527 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:12.813116 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:12.869211 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2457e55-57b2-45c2-ad6f-f09707e25111 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:12.909077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bbabd-7d33-4a08-864a-cf83999b10fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:12.909707 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bbabd-7d33-4a08-864a-cf83999b10fa None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:12.909983 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bbabd-7d33-4a08-864a-cf83999b10fa None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:12.910248 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bbabd-7d33-4a08-864a-cf83999b10fa None admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:12.910923 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bbabd-7d33-4a08-864a-cf83999b10fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:12.911223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bbabd-7d33-4a08-864a-cf83999b10fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:12.912658 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bbabd-7d33-4a08-864a-cf83999b10fa None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:12.926599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 453/907] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 22 20:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:12.936036 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:13.042630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d6974-809f-4883-a635-e7957f1e7d7e None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:13.078023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a76e-2739-48b2-afae-2df0e04c52e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:13.078617 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a76e-2739-48b2-afae-2df0e04c52e2 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:13.078889 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a76e-2739-48b2-afae-2df0e04c52e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:13.079148 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a76e-2739-48b2-afae-2df0e04c52e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:13.079852 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a76e-2739-48b2-afae-2df0e04c52e2 None admin] RBAC: Adding query filter params (role.id=5704f5205ad0422aaaf403ee517bd1a1, scope.project.id=b23a3011ea504944be8e0d8f3394d7df, user.id=48a5ba0a3da749309b1c514b13a3141b) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:13.080148 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a76e-2739-48b2-afae-2df0e04c52e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:13.081606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a76e-2739-48b2-afae-2df0e04c52e2 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:13.087336 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 455/908] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 22 20:42:12 2022] GET /identity/v3/role_assignments?user.id=48a5ba0a3da749309b1c514b13a3141b&scope.project.id=b23a3011ea504944be8e0d8f3394d7df&role.id=5704f5205ad0422aaaf403ee517bd1a1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:15.302210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292ed46-ab5f-44ad-b829-87d5830acb98 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:15.302767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292ed46-ab5f-44ad-b829-87d5830acb98 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:15.302767 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292ed46-ab5f-44ad-b829-87d5830acb98 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:15.304061 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 454/909] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:15.310599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5709fe-727a-4929-bf4a-8b62dceb8c00 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:15.311367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5709fe-727a-4929-bf4a-8b62dceb8c00 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:15.311487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5709fe-727a-4929-bf4a-8b62dceb8c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:15.331697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-9b5709fe-727a-4929-bf4a-8b62dceb8c00 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:15.332863 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-9b5709fe-727a-4929-bf4a-8b62dceb8c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:15.363868 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:15.403941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 456/910] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:42:15.729807 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292ed46-ab5f-44ad-b829-87d5830acb98 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:15.858820 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292ed46-ab5f-44ad-b829-87d5830acb98 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:15.867344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:15.900987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:15.901652 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:15.901930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:15.902360 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] PATH_INFO: `/v3/services/placement` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:15.902944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:15.904310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:15.913238 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:15.914279 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:15.915131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:15.917273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 455/911] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 22 20:42:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:15.920540 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5709fe-727a-4929-bf4a-8b62dceb8c00 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:16.030027 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5709fe-727a-4929-bf4a-8b62dceb8c00 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:16.064108 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df69f-7597-4fad-8149-fd6cd89090fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:16.064694 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df69f-7597-4fad-8149-fd6cd89090fa None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:16.064962 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df69f-7597-4fad-8149-fd6cd89090fa None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:16.065258 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df69f-7597-4fad-8149-fd6cd89090fa None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:16.065872 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df69f-7597-4fad-8149-fd6cd89090fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:16.066193 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df69f-7597-4fad-8149-fd6cd89090fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:16.067561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df69f-7597-4fad-8149-fd6cd89090fa None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:16.072488 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 457/912] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 22 20:42:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:16.082027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:16.199773 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16f858-0146-4cc3-94d2-453f7eef6681 None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:16.240009 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df06157-8143-4d80-9d95-a76896d087c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:16.240609 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df06157-8143-4d80-9d95-a76896d087c8 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:16.240886 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df06157-8143-4d80-9d95-a76896d087c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:16.241176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df06157-8143-4d80-9d95-a76896d087c8 None admin] PATH_INFO: `/v3/services` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:16.241808 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df06157-8143-4d80-9d95-a76896d087c8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:16.242108 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df06157-8143-4d80-9d95-a76896d087c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:16.243476 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df06157-8143-4d80-9d95-a76896d087c8 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:16.248847 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 456/913] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 22 20:42:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:18.431920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173df60-6acf-4048-bfb1-0ab2305e8d8a None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:18.432769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173df60-6acf-4048-bfb1-0ab2305e8d8a None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:18.432769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173df60-6acf-4048-bfb1-0ab2305e8d8a None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:18.434775 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 458/914] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:42:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:18.443589 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3fc0e-f7f6-437a-bf67-8d48c65cdbcb None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:18.444308 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3fc0e-f7f6-437a-bf67-8d48c65cdbcb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:18.444431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3fc0e-f7f6-437a-bf67-8d48c65cdbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:18.472591 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-f3b3fc0e-f7f6-437a-bf67-8d48c65cdbcb None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:18.473841 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-f3b3fc0e-f7f6-437a-bf67-8d48c65cdbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:18.505960 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:18.550231 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 457/915] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:42:18.882446 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173df60-6acf-4048-bfb1-0ab2305e8d8a None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:18.927291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:19.031567 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173df60-6acf-4048-bfb1-0ab2305e8d8a None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:19.067107 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ac2b2-fb78-47bf-b854-5fafd39dec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:19.067680 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ac2b2-fb78-47bf-b854-5fafd39dec36 None admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:19.067964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ac2b2-fb78-47bf-b854-5fafd39dec36 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:19.068256 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ac2b2-fb78-47bf-b854-5fafd39dec36 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:19.068864 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ac2b2-fb78-47bf-b854-5fafd39dec36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:19.070301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ac2b2-fb78-47bf-b854-5fafd39dec36 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:19.091152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 459/916] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 22 20:42:18 2022] POST /identity/v3/services => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:42:21.274736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e05ded-faf2-46ca-96ed-07bb5978e6e8 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:21.275346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e05ded-faf2-46ca-96ed-07bb5978e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:21.275473 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e05ded-faf2-46ca-96ed-07bb5978e6e8 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:21.277262 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 458/917] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:21.283735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7758-931f-4d2c-a9ef-39dd67634572 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:21.284417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7758-931f-4d2c-a9ef-39dd67634572 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:21.284417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7758-931f-4d2c-a9ef-39dd67634572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:21.311884 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-2e1b7758-931f-4d2c-a9ef-39dd67634572 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:21.313077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-2e1b7758-931f-4d2c-a9ef-39dd67634572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:21.414942 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 460/918] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:21 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:42:21.752723 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e05ded-faf2-46ca-96ed-07bb5978e6e8 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:21.867469 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e05ded-faf2-46ca-96ed-07bb5978e6e8 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:21.906854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:21.907488 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:21.907754 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:21.908021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] PATH_INFO: `/v3/services/placement` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:21.908583 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:21.910017 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:21.919367 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:21.921318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:21.922654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 459/919] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 22 20:42:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:21.930027 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7758-931f-4d2c-a9ef-39dd67634572 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:21.955271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:22.061832 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7758-931f-4d2c-a9ef-39dd67634572 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:22.099865 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:22.100463 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:22.100731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:22.100997 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:22.101647 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:22.101917 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:22.103377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:22.109452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 461/920] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 22 20:42:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:22.115860 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:22.153419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:22.243068 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea62088-d461-4ac4-be7f-8e559937c01e None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:22.287718 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be68f8-ba0e-4940-8548-bdaae0931456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:22.288432 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be68f8-ba0e-4940-8548-bdaae0931456 None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:22.288549 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be68f8-ba0e-4940-8548-bdaae0931456 None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:22.288815 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be68f8-ba0e-4940-8548-bdaae0931456 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:22.290683 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be68f8-ba0e-4940-8548-bdaae0931456 None admin] RBAC: Adding query filter params (interface=public, service_id=93a2c1ecc58f4445a62f16eced87466a, region_id=RegionOne) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:22.290973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be68f8-ba0e-4940-8548-bdaae0931456 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:22.292332 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be68f8-ba0e-4940-8548-bdaae0931456 None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:22.298812 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 460/921] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 22 20:42:22 2022] GET /identity/v3/endpoints?service_id=93a2c1ecc58f4445a62f16eced87466a&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:22.306864 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:22.399860 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:22.420590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fcf79-b8ad-4548-a342-0a389feeace5 None admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:22.465693 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670bcf0-ea60-4a15-ae1c-67c2e3b0d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:22.466347 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670bcf0-ea60-4a15-ae1c-67c2e3b0d191 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:22.466630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670bcf0-ea60-4a15-ae1c-67c2e3b0d191 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:22.466895 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670bcf0-ea60-4a15-ae1c-67c2e3b0d191 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:22.467496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670bcf0-ea60-4a15-ae1c-67c2e3b0d191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:22.468864 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670bcf0-ea60-4a15-ae1c-67c2e3b0d191 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:22.475885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 462/922] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 22 20:42:22 2022] GET /identity/v3/services => generated 1962 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:42:24.726140 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b6bc-dcf0-401b-99c7-f1699ec5af54 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:24.727052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b6bc-dcf0-401b-99c7-f1699ec5af54 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:24.727052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b6bc-dcf0-401b-99c7-f1699ec5af54 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:24.729174 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 461/923] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:24.736155 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a31a-6fe8-4f53-a812-4a10d7249064 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:24.736652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a31a-6fe8-4f53-a812-4a10d7249064 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:24.736652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a31a-6fe8-4f53-a812-4a10d7249064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:24.764165 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-c393a31a-6fe8-4f53-a812-4a10d7249064 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:24.765426 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-c393a31a-6fe8-4f53-a812-4a10d7249064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:24.834349 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 463/924] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:24 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:42:25.166161 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b6bc-dcf0-401b-99c7-f1699ec5af54 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:25.269784 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:25.280598 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b6bc-dcf0-401b-99c7-f1699ec5af54 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:25.318881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:25.319509 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:25.319776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:25.320031 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] PATH_INFO: `/v3/services/placement` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:25.320618 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:25.322029 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:42:25.331713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:42:25.332899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application with Lock( Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: ERROR keystone.server.flask.application Aug 22 20:42:25.333962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 462/925] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 22 20:42:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:42:25.339073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a31a-6fe8-4f53-a812-4a10d7249064 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:25.429373 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:25.453853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a31a-6fe8-4f53-a812-4a10d7249064 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:25.489961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646fc5d-be6b-4eec-ac05-a45616bf1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:25.490575 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646fc5d-be6b-4eec-ac05-a45616bf1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:25.490852 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646fc5d-be6b-4eec-ac05-a45616bf1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:25.491114 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646fc5d-be6b-4eec-ac05-a45616bf1dc1 None admin] PATH_INFO: `/v3/services` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:25.491738 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646fc5d-be6b-4eec-ac05-a45616bf1dc1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:42:25.492039 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646fc5d-be6b-4eec-ac05-a45616bf1dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:25.493445 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646fc5d-be6b-4eec-ac05-a45616bf1dc1 None admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:25.499730 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 464/926] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 22 20:42:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:25.506320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:25.629804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e53ea8-cca1-4eee-89ac-1f5483ad797d None admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:25.666240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bba507-9ba3-466b-a8fd-38d177dc75ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:25.666831 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bba507-9ba3-466b-a8fd-38d177dc75ba None admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:25.667103 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bba507-9ba3-466b-a8fd-38d177dc75ba None admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:25.667374 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bba507-9ba3-466b-a8fd-38d177dc75ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:25.668364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bba507-9ba3-466b-a8fd-38d177dc75ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:25.669799 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bba507-9ba3-466b-a8fd-38d177dc75ba None admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:25.692171 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 463/927] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:42:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:42:35.496108 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=30 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:35.687626 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:29.943998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd843-e2a3-42a5-ba2a-1b77e69dc6ff None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:29.944568 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd843-e2a3-42a5-ba2a-1b77e69dc6ff None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:29.944568 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd843-e2a3-42a5-ba2a-1b77e69dc6ff None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:29.945931 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 465/928] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:29.952089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f6524-613c-4df5-b7c8-b7107981db6c None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:29.952553 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f6524-613c-4df5-b7c8-b7107981db6c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:29.952632 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f6524-613c-4df5-b7c8-b7107981db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:29.981207 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-a06f6524-613c-4df5-b7c8-b7107981db6c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:29.982805 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-a06f6524-613c-4df5-b7c8-b7107981db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:30.071759 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 464/929] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:30.439348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7a75-c006-4e99-8e04-cf8edeb0a1f7 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:30.439634 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7a75-c006-4e99-8e04-cf8edeb0a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:30.439940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7a75-c006-4e99-8e04-cf8edeb0a1f7 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:30.441562 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 466/930] 10.222.0.50 () {54 vars in 965 bytes} [Mon Aug 22 20:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:30.449769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd70eb-7ac4-4255-b72b-ca1f0832d43c None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:30.449769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd70eb-7ac4-4255-b72b-ca1f0832d43c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:30.449769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd70eb-7ac4-4255-b72b-ca1f0832d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:30.512141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-7fcd70eb-7ac4-4255-b72b-ca1f0832d43c None None] MFA Rules not processed for user `f344891bb32f4d86ab3c2536c3a4ae68`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:30.512141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-7fcd70eb-7ac4-4255-b72b-ca1f0832d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:30.598893 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 465/931] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Aug 22 20:43:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:43:30.615014 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e7a75-c006-4e99-8e04-cf8edeb0a1f7 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:30.638001 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e7a75-c006-4e99-8e04-cf8edeb0a1f7 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:30.642816 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3dcc5-328e-4593-9d23-490a54d07b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:30.643610 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3dcc5-328e-4593-9d23-490a54d07b19 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:30.644053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3dcc5-328e-4593-9d23-490a54d07b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:30.644708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3dcc5-328e-4593-9d23-490a54d07b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:30.658071 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3dcc5-328e-4593-9d23-490a54d07b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:30.660214 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3dcc5-328e-4593-9d23-490a54d07b19 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:30.671229 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 467/932] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:33.106993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884c0b-19e8-4e03-b733-7feb77ecc1fa None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:33.107570 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884c0b-19e8-4e03-b733-7feb77ecc1fa None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:33.107570 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884c0b-19e8-4e03-b733-7feb77ecc1fa None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:33.108843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 466/933] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:33.114480 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d79a3-959c-4bdb-9e38-b8bd6235e414 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:33.114913 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d79a3-959c-4bdb-9e38-b8bd6235e414 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:33.115004 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d79a3-959c-4bdb-9e38-b8bd6235e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:33.135122 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-4c5d79a3-959c-4bdb-9e38-b8bd6235e414 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:33.136336 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-4c5d79a3-959c-4bdb-9e38-b8bd6235e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:33.144512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 468/934] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:33.487063 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b884c0b-19e8-4e03-b733-7feb77ecc1fa None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:33.502595 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b884c0b-19e8-4e03-b733-7feb77ecc1fa None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:33.506833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a20f-b824-4920-bdb8-71948a4178c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:33.507848 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a20f-b824-4920-bdb8-71948a4178c6 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:33.508201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a20f-b824-4920-bdb8-71948a4178c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:33.508546 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a20f-b824-4920-bdb8-71948a4178c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:33.519868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a20f-b824-4920-bdb8-71948a4178c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:33.522042 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a20f-b824-4920-bdb8-71948a4178c6 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:33.536384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 467/935] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:36.162955 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834567-53c9-4c46-b7ef-065cd93042e1 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:36.163716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834567-53c9-4c46-b7ef-065cd93042e1 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:36.163716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834567-53c9-4c46-b7ef-065cd93042e1 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:36.164948 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 469/936] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:36.170666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05895b8-4cdb-4b04-9734-284928c1e6b8 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:36.171188 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05895b8-4cdb-4b04-9734-284928c1e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:36.171188 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05895b8-4cdb-4b04-9734-284928c1e6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:36.217831 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-e05895b8-4cdb-4b04-9734-284928c1e6b8 None None] MFA Rules not processed for user `0b221a3f137341cf93708c3554576822`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:36.219060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-e05895b8-4cdb-4b04-9734-284928c1e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:36.267810 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:36.300442 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 468/937] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:36 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:36.676290 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09834567-53c9-4c46-b7ef-065cd93042e1 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:36.690691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09834567-53c9-4c46-b7ef-065cd93042e1 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:36.695731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f542f-781e-415b-bef5-abe53797313a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:36.696391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f542f-781e-415b-bef5-abe53797313a service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:36.696722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f542f-781e-415b-bef5-abe53797313a service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:36.697021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f542f-781e-415b-bef5-abe53797313a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:36.708736 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f542f-781e-415b-bef5-abe53797313a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:36.711022 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f542f-781e-415b-bef5-abe53797313a service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:36.723622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 470/938] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:36 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:39.678237 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f028-8802-4b88-8582-01b579d62998 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:39.678814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f028-8802-4b88-8582-01b579d62998 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:39.679194 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f028-8802-4b88-8582-01b579d62998 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:39.680821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 469/939] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:39.687699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6aa32-4614-4ddb-beb7-3346c4d25c81 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:39.688291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6aa32-4614-4ddb-beb7-3346c4d25c81 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:39.688291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6aa32-4614-4ddb-beb7-3346c4d25c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:39.717721 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-2ad6aa32-4614-4ddb-beb7-3346c4d25c81 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:39.719050 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-2ad6aa32-4614-4ddb-beb7-3346c4d25c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:39.809205 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 471/940] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:39 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:40.152112 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09f028-8802-4b88-8582-01b579d62998 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:40.162974 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09f028-8802-4b88-8582-01b579d62998 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:40.166506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857a33-3ec3-4ef0-919d-5df26dfdd2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:40.167170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857a33-3ec3-4ef0-919d-5df26dfdd2cc service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:40.167480 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857a33-3ec3-4ef0-919d-5df26dfdd2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:40.167792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857a33-3ec3-4ef0-919d-5df26dfdd2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:40.178483 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad857a33-3ec3-4ef0-919d-5df26dfdd2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:40.179912 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad857a33-3ec3-4ef0-919d-5df26dfdd2cc service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:40.190219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 470/941] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:40 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:43.178843 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaff4e3-1c7b-4b46-a227-faad33afcfca None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:43.179407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaff4e3-1c7b-4b46-a227-faad33afcfca None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:43.179407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaff4e3-1c7b-4b46-a227-faad33afcfca None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:43.180771 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 472/942] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:43.187198 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d89b6f-f0c3-47df-99bd-2e8e273c957f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:43.187702 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d89b6f-f0c3-47df-99bd-2e8e273c957f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:43.187814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d89b6f-f0c3-47df-99bd-2e8e273c957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:43.210089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-09d89b6f-f0c3-47df-99bd-2e8e273c957f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:43.211379 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-09d89b6f-f0c3-47df-99bd-2e8e273c957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:43.220638 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 471/943] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:43.596363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72680a3-66fe-4116-a6e7-492702448ad4 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:43.596790 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72680a3-66fe-4116-a6e7-492702448ad4 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:43.597261 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72680a3-66fe-4116-a6e7-492702448ad4 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:43.599692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 473/944] 10.222.0.50 () {54 vars in 965 bytes} [Mon Aug 22 20:43:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:43.608593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8dd1-44b8-4b55-bf1d-0834820f0feb None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:43.609017 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8dd1-44b8-4b55-bf1d-0834820f0feb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:43.609467 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8dd1-44b8-4b55-bf1d-0834820f0feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:43.653506 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-e6da8dd1-44b8-4b55-bf1d-0834820f0feb None None] MFA Rules not processed for user `f344891bb32f4d86ab3c2536c3a4ae68`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:43.654989 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-e6da8dd1-44b8-4b55-bf1d-0834820f0feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:43.664814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 472/945] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Aug 22 20:43:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:43.678924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72680a3-66fe-4116-a6e7-492702448ad4 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:43.692349 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72680a3-66fe-4116-a6e7-492702448ad4 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:43.697613 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d889fa-4fd7-4a94-bf09-7cb4a60be1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:43.698961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d889fa-4fd7-4a94-bf09-7cb4a60be1df service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:43.699240 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d889fa-4fd7-4a94-bf09-7cb4a60be1df service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:43.699519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d889fa-4fd7-4a94-bf09-7cb4a60be1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:43.710716 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d889fa-4fd7-4a94-bf09-7cb4a60be1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:43.712533 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d889fa-4fd7-4a94-bf09-7cb4a60be1df service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:43.723755 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 474/946] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:43:46.327872 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf54e4-5801-4367-afa9-3cf4c0d549ad None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:46.328511 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf54e4-5801-4367-afa9-3cf4c0d549ad None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:46.328511 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf54e4-5801-4367-afa9-3cf4c0d549ad None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:46.329850 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 473/947] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:46.335866 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb62917-642a-4f3d-a32d-268e51b30217 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:46.336406 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb62917-642a-4f3d-a32d-268e51b30217 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:46.336498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb62917-642a-4f3d-a32d-268e51b30217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:46.357317 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-8fb62917-642a-4f3d-a32d-268e51b30217 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:46.358673 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-8fb62917-642a-4f3d-a32d-268e51b30217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:46.367496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 475/948] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:46.726268 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf54e4-5801-4367-afa9-3cf4c0d549ad None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:46.740560 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf54e4-5801-4367-afa9-3cf4c0d549ad None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:46.745254 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418f9d-909d-4729-b790-13355740e480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:46.746641 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418f9d-909d-4729-b790-13355740e480 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:46.747172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418f9d-909d-4729-b790-13355740e480 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:46.747649 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418f9d-909d-4729-b790-13355740e480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:46.762052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418f9d-909d-4729-b790-13355740e480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:46.764000 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418f9d-909d-4729-b790-13355740e480 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:46.775780 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 474/949] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:49.130622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2173-48b8-4440-bbcb-719f889c047f None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:49.130622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2173-48b8-4440-bbcb-719f889c047f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:49.131301 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2173-48b8-4440-bbcb-719f889c047f None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:49.132796 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 476/950] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:49.138490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3133f-958d-43d5-954f-3e05cbe5cb64 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:49.138967 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3133f-958d-43d5-954f-3e05cbe5cb64 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:49.139066 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3133f-958d-43d5-954f-3e05cbe5cb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:49.159914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-65b3133f-958d-43d5-954f-3e05cbe5cb64 None None] MFA Rules not processed for user `0b221a3f137341cf93708c3554576822`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:49.161133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-65b3133f-958d-43d5-954f-3e05cbe5cb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:49.169220 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 475/951] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:49 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:49.505225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2173-48b8-4440-bbcb-719f889c047f None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:49.518053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2173-48b8-4440-bbcb-719f889c047f None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:49.521808 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61cc25-6985-41e0-aaee-193bf33a25e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:49.522444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cc25-6985-41e0-aaee-193bf33a25e1 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:49.522713 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cc25-6985-41e0-aaee-193bf33a25e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:49.522978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cc25-6985-41e0-aaee-193bf33a25e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:49.534228 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61cc25-6985-41e0-aaee-193bf33a25e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:49.535678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61cc25-6985-41e0-aaee-193bf33a25e1 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:49.547314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 477/952] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:49 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:52.064913 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56f52-3d0b-47c4-8f61-6e551098a633 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:52.065664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56f52-3d0b-47c4-8f61-6e551098a633 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:52.065664 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56f52-3d0b-47c4-8f61-6e551098a633 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:52.067155 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 476/953] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:52.073414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad17ab-a69c-470d-88bd-a234d8af18cd None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:52.074310 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad17ab-a69c-470d-88bd-a234d8af18cd None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:52.074603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad17ab-a69c-470d-88bd-a234d8af18cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:52.099735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-3cad17ab-a69c-470d-88bd-a234d8af18cd None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:52.101078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-3cad17ab-a69c-470d-88bd-a234d8af18cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:52.115187 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 478/954] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:43:52.466678 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab56f52-3d0b-47c4-8f61-6e551098a633 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:52.480053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab56f52-3d0b-47c4-8f61-6e551098a633 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:52.483625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af028b-ebd2-4019-aab6-da64d0bf5d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:52.484233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af028b-ebd2-4019-aab6-da64d0bf5d89 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:52.484505 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af028b-ebd2-4019-aab6-da64d0bf5d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:52.484776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af028b-ebd2-4019-aab6-da64d0bf5d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:52.494538 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af028b-ebd2-4019-aab6-da64d0bf5d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:52.496122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af028b-ebd2-4019-aab6-da64d0bf5d89 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:52.507528 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 477/955] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:54.884816 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eee161-d8ca-4503-b9d8-74a0a4726f71 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:54.885560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eee161-d8ca-4503-b9d8-74a0a4726f71 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:54.885560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eee161-d8ca-4503-b9d8-74a0a4726f71 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:54.886908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 479/956] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:54.892510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09092-adac-4444-bc44-5f47f627452d None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:54.892933 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09092-adac-4444-bc44-5f47f627452d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:54.893043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09092-adac-4444-bc44-5f47f627452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:54.912874 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9ca09092-adac-4444-bc44-5f47f627452d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:54.914101 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9ca09092-adac-4444-bc44-5f47f627452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:54.922706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 478/957] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:55.280451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eee161-d8ca-4503-b9d8-74a0a4726f71 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:55.293963 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eee161-d8ca-4503-b9d8-74a0a4726f71 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:55.297958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e37d-ebd7-494d-bc93-e127ff00e231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:55.298660 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e37d-ebd7-494d-bc93-e127ff00e231 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:55.298979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e37d-ebd7-494d-bc93-e127ff00e231 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:55.299373 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e37d-ebd7-494d-bc93-e127ff00e231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:55.310452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e37d-ebd7-494d-bc93-e127ff00e231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:55.311882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e37d-ebd7-494d-bc93-e127ff00e231 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:55.324051 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 480/958] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:43:58.298528 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b3a2-e5f7-44e5-8201-4ebc2fd95880 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:58.299131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b3a2-e5f7-44e5-8201-4ebc2fd95880 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:58.299131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b3a2-e5f7-44e5-8201-4ebc2fd95880 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:58.300382 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 479/959] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:58.306062 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cae30-6d59-47b7-8076-f761c1adacf4 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:58.306585 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cae30-6d59-47b7-8076-f761c1adacf4 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:58.306585 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cae30-6d59-47b7-8076-f761c1adacf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:58.314113 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=71 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:58.327644 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e93cae30-6d59-47b7-8076-f761c1adacf4 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:58.328864 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e93cae30-6d59-47b7-8076-f761c1adacf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:58.336839 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 481/960] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:58 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:58.677968 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b3a2-e5f7-44e5-8201-4ebc2fd95880 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:58.689766 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b3a2-e5f7-44e5-8201-4ebc2fd95880 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:58.693453 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b62b1-735a-426e-b02e-6306b0f797b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:58.694051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b62b1-735a-426e-b02e-6306b0f797b7 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:58.694324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b62b1-735a-426e-b02e-6306b0f797b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:58.694584 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b62b1-735a-426e-b02e-6306b0f797b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:58.705465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b62b1-735a-426e-b02e-6306b0f797b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:58.707060 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b62b1-735a-426e-b02e-6306b0f797b7 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:58.719237 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 480/961] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:58 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:03.388520 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315b624-c8d9-41c6-8dff-0e8e56e3c500 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:03.389307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315b624-c8d9-41c6-8dff-0e8e56e3c500 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:03.389307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315b624-c8d9-41c6-8dff-0e8e56e3c500 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:03.390440 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 482/962] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:03.397662 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ed95-2e3e-491e-a39b-f0e6909bc06f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:03.398334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ed95-2e3e-491e-a39b-f0e6909bc06f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:03.398334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ed95-2e3e-491e-a39b-f0e6909bc06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:03.419206 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-faa2ed95-2e3e-491e-a39b-f0e6909bc06f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:03.420410 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-faa2ed95-2e3e-491e-a39b-f0e6909bc06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:03.428256 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 481/963] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:03.786225 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315b624-c8d9-41c6-8dff-0e8e56e3c500 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:03.797992 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315b624-c8d9-41c6-8dff-0e8e56e3c500 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:03.801649 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98d63d-1d8c-4536-9846-0edd8172432d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:03.802249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d63d-1d8c-4536-9846-0edd8172432d service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:03.802521 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d63d-1d8c-4536-9846-0edd8172432d service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:03.802781 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d63d-1d8c-4536-9846-0edd8172432d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:03.812733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98d63d-1d8c-4536-9846-0edd8172432d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:03.814199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98d63d-1d8c-4536-9846-0edd8172432d service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:03.824816 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 483/964] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:06.782246 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda66d-8593-46ca-ba86-cb54b8a414cb None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:06.782921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda66d-8593-46ca-ba86-cb54b8a414cb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:06.782921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda66d-8593-46ca-ba86-cb54b8a414cb None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:06.784088 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 482/965] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:06.789513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7655a1d-0828-445e-b29d-e0f719b3ca9f None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:06.789971 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7655a1d-0828-445e-b29d-e0f719b3ca9f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:06.790073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7655a1d-0828-445e-b29d-e0f719b3ca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:06.809761 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e7655a1d-0828-445e-b29d-e0f719b3ca9f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:06.812396 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e7655a1d-0828-445e-b29d-e0f719b3ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:06.818840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 484/966] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:06 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:07.154491 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda66d-8593-46ca-ba86-cb54b8a414cb None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:07.160489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=51 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:07.168290 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda66d-8593-46ca-ba86-cb54b8a414cb None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:07.172005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7270c-0c4d-4eef-a615-f0cd1fbdb814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:07.172714 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7270c-0c4d-4eef-a615-f0cd1fbdb814 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:07.173053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7270c-0c4d-4eef-a615-f0cd1fbdb814 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:07.173449 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7270c-0c4d-4eef-a615-f0cd1fbdb814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:07.183550 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7270c-0c4d-4eef-a615-f0cd1fbdb814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:07.184984 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7270c-0c4d-4eef-a615-f0cd1fbdb814 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:07.194647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 483/967] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:07 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:11.892095 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea74f33-f901-4d06-9458-0fa0dd784485 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:11.892687 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea74f33-f901-4d06-9458-0fa0dd784485 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:11.892687 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea74f33-f901-4d06-9458-0fa0dd784485 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:11.894011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 485/968] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:11.899844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b143-3ddc-4f5e-9d6d-6f65b1ad3ac3 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:11.900336 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b143-3ddc-4f5e-9d6d-6f65b1ad3ac3 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:11.900503 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b143-3ddc-4f5e-9d6d-6f65b1ad3ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:11.921809 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-f588b143-3ddc-4f5e-9d6d-6f65b1ad3ac3 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:11.923319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-f588b143-3ddc-4f5e-9d6d-6f65b1ad3ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:11.933261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 484/969] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:12.283792 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea74f33-f901-4d06-9458-0fa0dd784485 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:12.296531 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea74f33-f901-4d06-9458-0fa0dd784485 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:12.300497 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5319b-54fe-491b-ad6e-e6d2b83c4743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:12.301183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5319b-54fe-491b-ad6e-e6d2b83c4743 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:12.301460 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5319b-54fe-491b-ad6e-e6d2b83c4743 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:12.301726 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5319b-54fe-491b-ad6e-e6d2b83c4743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:12.311424 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5319b-54fe-491b-ad6e-e6d2b83c4743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:12.312880 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5319b-54fe-491b-ad6e-e6d2b83c4743 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:12.322882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 486/970] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:18.226248 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3132fb-3ee7-4f4e-be8a-a4d3b52e68cd None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:18.227121 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3132fb-3ee7-4f4e-be8a-a4d3b52e68cd None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:18.227606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3132fb-3ee7-4f4e-be8a-a4d3b52e68cd None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:18.231673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 485/971] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 20:44:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:44:18.237089 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4235-4db1-4218-840a-7daa4124f8e8 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:18.238139 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4235-4db1-4218-840a-7daa4124f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:18.239218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4235-4db1-4218-840a-7daa4124f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:18.302677 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e88d4235-4db1-4218-840a-7daa4124f8e8 None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:18.304232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e88d4235-4db1-4218-840a-7daa4124f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:18.417784 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 487/972] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 20:44:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:21.915388 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=8 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:23.533888 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4add8-6fb2-4e29-97c4-a57c0cb45b80 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:23.535049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4add8-6fb2-4e29-97c4-a57c0cb45b80 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:23.535719 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4add8-6fb2-4e29-97c4-a57c0cb45b80 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:23.537519 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 486/973] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 20:44:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:23.545783 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84f987-9447-4bbb-a0eb-c58a2ea9455a None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:23.547283 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84f987-9447-4bbb-a0eb-c58a2ea9455a None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:23.548029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84f987-9447-4bbb-a0eb-c58a2ea9455a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:23.583086 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-5a84f987-9447-4bbb-a0eb-c58a2ea9455a None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:23.585182 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-5a84f987-9447-4bbb-a0eb-c58a2ea9455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:23.598106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 488/974] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 20:44:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:25.603606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d6b35-2fd4-461a-8511-cc7fa7048fc9 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:25.604312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d6b35-2fd4-461a-8511-cc7fa7048fc9 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:25.604312 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d6b35-2fd4-461a-8511-cc7fa7048fc9 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:25.605408 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 487/975] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 20:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:25.612218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5725-8204-40b0-8df2-35081f49a4e8 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:25.613029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5725-8204-40b0-8df2-35081f49a4e8 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:25.613029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5725-8204-40b0-8df2-35081f49a4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:25.637854 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-6d1b5725-8204-40b0-8df2-35081f49a4e8 None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:25.639437 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-6d1b5725-8204-40b0-8df2-35081f49a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:25.655176 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 489/976] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 20:44:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:29.571097 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ed856-88dd-488b-a42f-ed9be0bd8a0e None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:29.571585 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ed856-88dd-488b-a42f-ed9be0bd8a0e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:29.571682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ed856-88dd-488b-a42f-ed9be0bd8a0e None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:29.575255 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 488/977] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:29.581366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7bb23-fd61-4678-965a-82970020cafd None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:29.581856 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7bb23-fd61-4678-965a-82970020cafd None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:29.581856 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7bb23-fd61-4678-965a-82970020cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:29.590783 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=63 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:29.604094 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b1d7bb23-fd61-4678-965a-82970020cafd None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:29.605307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b1d7bb23-fd61-4678-965a-82970020cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:29.612898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 490/978] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:29.983017 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333838c5-ed37-4c18-93aa-d71ed1bc8e4b None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:29.983017 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333838c5-ed37-4c18-93aa-d71ed1bc8e4b None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:29.987732 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333838c5-ed37-4c18-93aa-d71ed1bc8e4b None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:29.987732 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 489/979] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 22 20:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:30.002573 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b69fb-f9f0-4d46-9f9c-83c43cc26973 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:30.003847 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b69fb-f9f0-4d46-9f9c-83c43cc26973 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:30.004459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b69fb-f9f0-4d46-9f9c-83c43cc26973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:30.059297 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-0b7b69fb-f9f0-4d46-9f9c-83c43cc26973 None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:30.060871 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-0b7b69fb-f9f0-4d46-9f9c-83c43cc26973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:30.150795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 491/980] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 22 20:44:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:30.159829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333838c5-ed37-4c18-93aa-d71ed1bc8e4b None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:30.176239 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333838c5-ed37-4c18-93aa-d71ed1bc8e4b None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:30.182602 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cacd7-f163-484c-876e-11823a371bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:30.183288 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cacd7-f163-484c-876e-11823a371bc9 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:30.183663 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cacd7-f163-484c-876e-11823a371bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:30.184007 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cacd7-f163-484c-876e-11823a371bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:30.193189 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cacd7-f163-484c-876e-11823a371bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:30.194868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cacd7-f163-484c-876e-11823a371bc9 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:30.204771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 490/981] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:32.688724 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b9ae5-a9e2-459f-86a7-efc390360b8d None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.689377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b9ae5-a9e2-459f-86a7-efc390360b8d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.689377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b9ae5-a9e2-459f-86a7-efc390360b8d None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.690772 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 492/982] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:32.696248 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af8677-8f4e-4ce4-abdc-c3df7803f43d None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.696791 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af8677-8f4e-4ce4-abdc-c3df7803f43d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.697389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af8677-8f4e-4ce4-abdc-c3df7803f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.717319 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-09af8677-8f4e-4ce4-abdc-c3df7803f43d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:32.718416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-09af8677-8f4e-4ce4-abdc-c3df7803f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:32.728558 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 491/983] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:33.085141 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b9ae5-a9e2-459f-86a7-efc390360b8d None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:33.103227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b9ae5-a9e2-459f-86a7-efc390360b8d None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:33.108283 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734f5b-9ec8-48df-a275-d37da9ff2b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:33.109005 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734f5b-9ec8-48df-a275-d37da9ff2b6d service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:33.109320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734f5b-9ec8-48df-a275-d37da9ff2b6d service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:33.109618 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734f5b-9ec8-48df-a275-d37da9ff2b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:33.118876 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734f5b-9ec8-48df-a275-d37da9ff2b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:33.120456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734f5b-9ec8-48df-a275-d37da9ff2b6d service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:33.134277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 493/984] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:35.772988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16384ee-38db-4538-87a2-44dc9cef1d88 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:35.773622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16384ee-38db-4538-87a2-44dc9cef1d88 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:35.773622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16384ee-38db-4538-87a2-44dc9cef1d88 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:35.775072 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 492/985] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:35.781011 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1be49-c190-4f36-819f-5fa5193d6fa7 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:35.781744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1be49-c190-4f36-819f-5fa5193d6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:35.781744 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1be49-c190-4f36-819f-5fa5193d6fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:35.808480 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-47f1be49-c190-4f36-819f-5fa5193d6fa7 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:35.809768 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-47f1be49-c190-4f36-819f-5fa5193d6fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:35.817739 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 494/986] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:36.164907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b439-c881-4021-8796-fa000ca533cb None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:36.165222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b439-c881-4021-8796-fa000ca533cb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:36.165680 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b439-c881-4021-8796-fa000ca533cb None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:36.167036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 493/987] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 22 20:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:44:36.173535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0698-0111-4562-82b3-32ab735b0290 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:36.174089 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0698-0111-4562-82b3-32ab735b0290 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:36.174606 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0698-0111-4562-82b3-32ab735b0290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:36.206623 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-ab4a0698-0111-4562-82b3-32ab735b0290 None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:36.208604 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-ab4a0698-0111-4562-82b3-32ab735b0290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:36.223560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 495/988] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 22 20:44:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:36.236887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b439-c881-4021-8796-fa000ca533cb None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:36.254883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b439-c881-4021-8796-fa000ca533cb None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:36.263461 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13424d-5ce3-40dc-a1f6-aa1bece9a8da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:36.264114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13424d-5ce3-40dc-a1f6-aa1bece9a8da service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:36.264454 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13424d-5ce3-40dc-a1f6-aa1bece9a8da service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:36.264933 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13424d-5ce3-40dc-a1f6-aa1bece9a8da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:36.275036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13424d-5ce3-40dc-a1f6-aa1bece9a8da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:36.277077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13424d-5ce3-40dc-a1f6-aa1bece9a8da service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:36.288949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 494/989] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:39.146276 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489229d-3cda-437e-ad50-7fc373ebe3c6 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:39.146903 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489229d-3cda-437e-ad50-7fc373ebe3c6 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:39.146903 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489229d-3cda-437e-ad50-7fc373ebe3c6 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:39.152939 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 496/990] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:39.155065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476434c6-e70b-4262-97e2-45b7e8c418bb None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:39.155894 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476434c6-e70b-4262-97e2-45b7e8c418bb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:39.156320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476434c6-e70b-4262-97e2-45b7e8c418bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:39.177533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-476434c6-e70b-4262-97e2-45b7e8c418bb None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:39.179039 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-476434c6-e70b-4262-97e2-45b7e8c418bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:39.201633 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 495/991] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:39.643958 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489229d-3cda-437e-ad50-7fc373ebe3c6 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:39.661875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489229d-3cda-437e-ad50-7fc373ebe3c6 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:39.668025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4148390-46d8-4f40-b6aa-5882eac92194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:39.668925 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148390-46d8-4f40-b6aa-5882eac92194 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:39.669443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148390-46d8-4f40-b6aa-5882eac92194 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:39.669967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148390-46d8-4f40-b6aa-5882eac92194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:39.682733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4148390-46d8-4f40-b6aa-5882eac92194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:39.684690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4148390-46d8-4f40-b6aa-5882eac92194 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:39.709603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 497/992] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:41.141729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82af276-a6d7-46e0-8d61-e08d1d3a9f03 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:41.142340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82af276-a6d7-46e0-8d61-e08d1d3a9f03 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:41.142340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82af276-a6d7-46e0-8d61-e08d1d3a9f03 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:41.148381 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 496/993] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:41.151296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5a81-5646-4f65-ae56-945231d46280 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:41.152332 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5a81-5646-4f65-ae56-945231d46280 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:41.152885 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5a81-5646-4f65-ae56-945231d46280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:41.185514 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-eb5b5a81-5646-4f65-ae56-945231d46280 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:41.187853 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-eb5b5a81-5646-4f65-ae56-945231d46280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:41.199648 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 498/994] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:42.010768 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb417-5b70-4555-b909-424079e3c9d4 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.010768 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb417-5b70-4555-b909-424079e3c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.010768 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb417-5b70-4555-b909-424079e3c9d4 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.013283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 497/995] 10.222.0.50 () {54 vars in 964 bytes} [Mon Aug 22 20:44:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:42.017385 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6f899-6b50-4f69-b219-2e880f399bc6 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.017669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6f899-6b50-4f69-b219-2e880f399bc6 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.017942 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6f899-6b50-4f69-b219-2e880f399bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.068081 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-40a6f899-6b50-4f69-b219-2e880f399bc6 None None] MFA Rules not processed for user `2e0c0dc1360a4dce928cbc27eab76ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:42.069626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-40a6f899-6b50-4f69-b219-2e880f399bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:42.156181 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 499/996] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Aug 22 20:44:42 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:42.165005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb417-5b70-4555-b909-424079e3c9d4 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:42.182490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb417-5b70-4555-b909-424079e3c9d4 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:42.189701 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbec85-5592-453a-af58-38f060f2b41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e0c0dc1360a4dce928cbc27eab76ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:42.191182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbec85-5592-453a-af58-38f060f2b41b service cinder] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.191609 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbec85-5592-453a-af58-38f060f2b41b service cinder] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.192172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbec85-5592-453a-af58-38f060f2b41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.208086 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbec85-5592-453a-af58-38f060f2b41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:42.209741 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbec85-5592-453a-af58-38f060f2b41b service cinder] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:42.221970 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b580a89-f99c-44bb-935d-7d49311d1aaa None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.222419 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b580a89-f99c-44bb-935d-7d49311d1aaa None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.222761 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b580a89-f99c-44bb-935d-7d49311d1aaa None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.223169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 498/997] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:42.223949 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 500/998] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:42.231999 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64296-f7b7-469c-acdc-ff38f97c38ce None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.232274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64296-f7b7-469c-acdc-ff38f97c38ce None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.232534 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64296-f7b7-469c-acdc-ff38f97c38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.265148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-a4d64296-f7b7-469c-acdc-ff38f97c38ce None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:42.267112 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-a4d64296-f7b7-469c-acdc-ff38f97c38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:42.282746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 499/999] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:42.645894 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b580a89-f99c-44bb-935d-7d49311d1aaa None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:42.670113 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b580a89-f99c-44bb-935d-7d49311d1aaa None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:42.678720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74576edc-e158-4da9-a4a4-4fd632d293bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:42.679654 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74576edc-e158-4da9-a4a4-4fd632d293bb service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.680088 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74576edc-e158-4da9-a4a4-4fd632d293bb service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.680501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74576edc-e158-4da9-a4a4-4fd632d293bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.691959 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74576edc-e158-4da9-a4a4-4fd632d293bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:42.693990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74576edc-e158-4da9-a4a4-4fd632d293bb service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:42.699010 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:42.707067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 501/1000] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:45.383672 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55545b6-07e6-4c81-9d38-d0bc6c7e31ef None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:45.384603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55545b6-07e6-4c81-9d38-d0bc6c7e31ef None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:45.385026 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55545b6-07e6-4c81-9d38-d0bc6c7e31ef None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:45.386678 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 500/1001] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:45.394179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34bec-c211-4ddd-b4f6-6cbaf298a5be None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:45.394674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34bec-c211-4ddd-b4f6-6cbaf298a5be None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:45.395006 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34bec-c211-4ddd-b4f6-6cbaf298a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:45.419625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-79e34bec-c211-4ddd-b4f6-6cbaf298a5be None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:45.421813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-79e34bec-c211-4ddd-b4f6-6cbaf298a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:45.436234 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 502/1002] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:45.795654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55545b6-07e6-4c81-9d38-d0bc6c7e31ef None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:45.818377 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55545b6-07e6-4c81-9d38-d0bc6c7e31ef None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:45.827430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707de45-c823-446d-86b2-9b8f4c1d5b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:45.828456 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707de45-c823-446d-86b2-9b8f4c1d5b89 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:45.828938 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707de45-c823-446d-86b2-9b8f4c1d5b89 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:45.829468 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707de45-c823-446d-86b2-9b8f4c1d5b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:45.845079 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707de45-c823-446d-86b2-9b8f4c1d5b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:45.848000 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707de45-c823-446d-86b2-9b8f4c1d5b89 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:45.862309 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 501/1003] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:48.348082 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d2ae-4307-4f49-bb49-9cf66261243d None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:48.348637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d2ae-4307-4f49-bb49-9cf66261243d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:48.348720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d2ae-4307-4f49-bb49-9cf66261243d None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:48.350113 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 503/1004] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:48.356539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7fa7-abad-4732-9a2e-b6ad89acdb11 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:48.357398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7fa7-abad-4732-9a2e-b6ad89acdb11 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:48.357398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7fa7-abad-4732-9a2e-b6ad89acdb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:48.378663 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-dc4f7fa7-abad-4732-9a2e-b6ad89acdb11 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:48.379886 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-dc4f7fa7-abad-4732-9a2e-b6ad89acdb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:48.389391 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 502/1005] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:48.763491 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d2ae-4307-4f49-bb49-9cf66261243d None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:48.783818 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d2ae-4307-4f49-bb49-9cf66261243d None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:48.789832 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf119f1-6757-4bb7-8a6d-e6cdbddf1297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:48.790594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf119f1-6757-4bb7-8a6d-e6cdbddf1297 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:48.790935 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf119f1-6757-4bb7-8a6d-e6cdbddf1297 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:48.791565 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf119f1-6757-4bb7-8a6d-e6cdbddf1297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:48.801837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf119f1-6757-4bb7-8a6d-e6cdbddf1297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:48.803601 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf119f1-6757-4bb7-8a6d-e6cdbddf1297 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:48.815514 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 504/1006] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:51.315112 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a197d2-0ac5-47d1-9374-0e2b078eb3b6 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:51.315574 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a197d2-0ac5-47d1-9374-0e2b078eb3b6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:51.315834 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a197d2-0ac5-47d1-9374-0e2b078eb3b6 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:51.316995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 503/1007] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:44:51.322713 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2799-7bf3-4d31-b115-dff22053679d None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:51.323312 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2799-7bf3-4d31-b115-dff22053679d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:51.323312 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2799-7bf3-4d31-b115-dff22053679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:51.345677 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-babb2799-7bf3-4d31-b115-dff22053679d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:51.346376 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-babb2799-7bf3-4d31-b115-dff22053679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:51.355987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 505/1008] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:51.816762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a197d2-0ac5-47d1-9374-0e2b078eb3b6 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:51.838796 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a197d2-0ac5-47d1-9374-0e2b078eb3b6 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:51.844701 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b7b75-2ab6-48fd-921f-aee4f9a05708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:51.845516 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b7b75-2ab6-48fd-921f-aee4f9a05708 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:51.845876 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b7b75-2ab6-48fd-921f-aee4f9a05708 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:51.846227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b7b75-2ab6-48fd-921f-aee4f9a05708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:51.858158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b7b75-2ab6-48fd-921f-aee4f9a05708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:51.860208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b7b75-2ab6-48fd-921f-aee4f9a05708 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:51.874383 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 504/1009] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:54.403009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea3577-248b-46eb-b5af-ae31a0361464 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.404158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea3577-248b-46eb-b5af-ae31a0361464 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.404158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea3577-248b-46eb-b5af-ae31a0361464 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.404857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 506/1010] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:54.412542 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80924-bdd0-42c7-8903-e672a1515ca6 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.413337 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80924-bdd0-42c7-8903-e672a1515ca6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.413995 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80924-bdd0-42c7-8903-e672a1515ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.429953 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=43 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:54.457269 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-c6e80924-bdd0-42c7-8903-e672a1515ca6 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:54.459931 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-c6e80924-bdd0-42c7-8903-e672a1515ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:54.476754 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 505/1011] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:54.846249 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea3577-248b-46eb-b5af-ae31a0361464 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:54.863722 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea3577-248b-46eb-b5af-ae31a0361464 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:54.869309 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f1075-27a1-4b93-8e45-8cfeebb26b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:54.869941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f1075-27a1-4b93-8e45-8cfeebb26b22 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.870235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f1075-27a1-4b93-8e45-8cfeebb26b22 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.870514 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f1075-27a1-4b93-8e45-8cfeebb26b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.879700 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f1075-27a1-4b93-8e45-8cfeebb26b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:54.881397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f1075-27a1-4b93-8e45-8cfeebb26b22 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:54.892714 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 507/1012] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:44:58.165877 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a14d9-7e55-4226-8272-47519b16cc2c None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:58.166892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a14d9-7e55-4226-8272-47519b16cc2c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:58.166892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a14d9-7e55-4226-8272-47519b16cc2c None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:58.171169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 506/1013] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:58.177203 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1789-8164-4068-bb6f-d4f3b815e491 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:58.177739 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1789-8164-4068-bb6f-d4f3b815e491 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:58.177739 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1789-8164-4068-bb6f-d4f3b815e491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:58.200156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-a65e1789-8164-4068-bb6f-d4f3b815e491 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:58.201453 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-a65e1789-8164-4068-bb6f-d4f3b815e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:58.209980 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 508/1014] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:58.570957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a14d9-7e55-4226-8272-47519b16cc2c None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:58.586208 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a14d9-7e55-4226-8272-47519b16cc2c None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:58.592490 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5504c7-d7b2-42bb-97e5-699c41ba24f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:58.593120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5504c7-d7b2-42bb-97e5-699c41ba24f5 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:58.593400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5504c7-d7b2-42bb-97e5-699c41ba24f5 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:58.593665 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5504c7-d7b2-42bb-97e5-699c41ba24f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:58.603000 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5504c7-d7b2-42bb-97e5-699c41ba24f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:58.605389 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5504c7-d7b2-42bb-97e5-699c41ba24f5 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:58.615841 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 507/1015] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:59.600676 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9797d1-0593-42d9-9ffa-e7ddd7af9dc0 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:59.601416 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9797d1-0593-42d9-9ffa-e7ddd7af9dc0 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:59.601416 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9797d1-0593-42d9-9ffa-e7ddd7af9dc0 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:59.603342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 509/1016] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:59.610033 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fa5f4-ad0e-4f61-9a64-3ab33b330451 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:59.610713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fa5f4-ad0e-4f61-9a64-3ab33b330451 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:59.610713 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fa5f4-ad0e-4f61-9a64-3ab33b330451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:59.633837 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-116fa5f4-ad0e-4f61-9a64-3ab33b330451 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:59.635270 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-116fa5f4-ad0e-4f61-9a64-3ab33b330451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:59.644210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 508/1017] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:00.013084 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd838b8-b437-43f6-bf24-767f3e16b441 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:00.013563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd838b8-b437-43f6-bf24-767f3e16b441 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:00.013966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd838b8-b437-43f6-bf24-767f3e16b441 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:00.015573 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 510/1018] 10.222.0.50 () {54 vars in 967 bytes} [Mon Aug 22 20:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:00.022662 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed1a6-cb3c-4b40-bd30-414217d34e09 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:00.023105 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed1a6-cb3c-4b40-bd30-414217d34e09 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:00.023558 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed1a6-cb3c-4b40-bd30-414217d34e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:00.068449 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-aa9ed1a6-cb3c-4b40-bd30-414217d34e09 None None] MFA Rules not processed for user `68490ffb61b54cc78d3104049f0e03ae`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:00.069912 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-aa9ed1a6-cb3c-4b40-bd30-414217d34e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:00.146212 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 509/1019] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Aug 22 20:45:00 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:00.154147 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd838b8-b437-43f6-bf24-767f3e16b441 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:00.168736 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd838b8-b437-43f6-bf24-767f3e16b441 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:00.173053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8fc6f-b8b6-4b45-899a-37b6e69e5a79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68490ffb61b54cc78d3104049f0e03ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:00.173965 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fc6f-b8b6-4b45-899a-37b6e69e5a79 service glance] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:00.174343 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fc6f-b8b6-4b45-899a-37b6e69e5a79 service glance] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:00.174708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fc6f-b8b6-4b45-899a-37b6e69e5a79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:00.188156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8fc6f-b8b6-4b45-899a-37b6e69e5a79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:00.190404 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8fc6f-b8b6-4b45-899a-37b6e69e5a79 service glance] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:00.203928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 511/1020] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:01.131451 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10858-a277-4c89-b8cf-9fcebe5809eb None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:01.132067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10858-a277-4c89-b8cf-9fcebe5809eb None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:01.132182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10858-a277-4c89-b8cf-9fcebe5809eb None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:01.134416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 510/1021] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:01.144580 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadc9c-51ea-4464-bf79-f7743d0e6f23 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:01.145597 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadc9c-51ea-4464-bf79-f7743d0e6f23 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:01.145855 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadc9c-51ea-4464-bf79-f7743d0e6f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:01.166131 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-85dadc9c-51ea-4464-bf79-f7743d0e6f23 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:01.167378 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-85dadc9c-51ea-4464-bf79-f7743d0e6f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:01.175389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 512/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:45:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:01.538264 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10858-a277-4c89-b8cf-9fcebe5809eb None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:01.560230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10858-a277-4c89-b8cf-9fcebe5809eb None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:01.565598 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1231dd0-9022-40a6-9301-4137f733103e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:01.566201 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231dd0-9022-40a6-9301-4137f733103e service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:01.566474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231dd0-9022-40a6-9301-4137f733103e service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:01.566741 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231dd0-9022-40a6-9301-4137f733103e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:01.576165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1231dd0-9022-40a6-9301-4137f733103e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:01.577872 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1231dd0-9022-40a6-9301-4137f733103e service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:01.591908 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 511/1023] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:04.175045 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8701bb-5cb0-4ce2-971d-e7b78df61e80 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:04.176182 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8701bb-5cb0-4ce2-971d-e7b78df61e80 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:04.176538 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8701bb-5cb0-4ce2-971d-e7b78df61e80 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:04.178145 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 513/1024] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:04.184724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70f45-b562-47ad-8941-ad5e8fc75458 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:04.185481 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70f45-b562-47ad-8941-ad5e8fc75458 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:04.185481 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70f45-b562-47ad-8941-ad5e8fc75458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:04.209757 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-2ee70f45-b562-47ad-8941-ad5e8fc75458 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:04.210982 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-2ee70f45-b562-47ad-8941-ad5e8fc75458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:04.220097 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 512/1025] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:04.596954 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8701bb-5cb0-4ce2-971d-e7b78df61e80 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:04.624136 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8701bb-5cb0-4ce2-971d-e7b78df61e80 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:04.630493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a79e6c-2b47-44fb-9eeb-9b1310ca78be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:04.631217 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79e6c-2b47-44fb-9eeb-9b1310ca78be service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:04.631605 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79e6c-2b47-44fb-9eeb-9b1310ca78be service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:04.631891 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79e6c-2b47-44fb-9eeb-9b1310ca78be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:04.645774 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a79e6c-2b47-44fb-9eeb-9b1310ca78be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:04.648626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a79e6c-2b47-44fb-9eeb-9b1310ca78be service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:04.675398 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 514/1026] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:45:14.203918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=53 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:14.660510 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=37 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:16.302005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb643d-9eb4-4216-a947-6ccdcbe9679b None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:16.302746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb643d-9eb4-4216-a947-6ccdcbe9679b None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:16.302746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb643d-9eb4-4216-a947-6ccdcbe9679b None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:16.303875 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 513/1027] 10.222.0.50 () {54 vars in 918 bytes} [Mon Aug 22 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:16.310275 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64db7-6940-45d0-8b13-712f5da77bcd None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:16.310826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64db7-6940-45d0-8b13-712f5da77bcd None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:16.310826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64db7-6940-45d0-8b13-712f5da77bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:16.334421 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-f4d64db7-6940-45d0-8b13-712f5da77bcd None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:16.335644 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-f4d64db7-6940-45d0-8b13-712f5da77bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:16.344899 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 515/1028] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Aug 22 20:45:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:16.360043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74372-ccfd-4b7e-a90f-2c6692d0d875 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:16.360320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74372-ccfd-4b7e-a90f-2c6692d0d875 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:16.360586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74372-ccfd-4b7e-a90f-2c6692d0d875 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:16.361951 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 514/1029] 10.222.0.50 () {54 vars in 918 bytes} [Mon Aug 22 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:16.367086 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279ceb-79e4-481b-a49b-749ca1998ec9 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:16.367362 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279ceb-79e4-481b-a49b-749ca1998ec9 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:16.367625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279ceb-79e4-481b-a49b-749ca1998ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:16.389746 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-38279ceb-79e4-481b-a49b-749ca1998ec9 None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:16.390952 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-38279ceb-79e4-481b-a49b-749ca1998ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:16.401078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 516/1030] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Aug 22 20:45:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:19.177883 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ba0f-eb2e-4e43-938f-b68ea03300ab None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:19.178520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ba0f-eb2e-4e43-938f-b68ea03300ab None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:19.178520 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ba0f-eb2e-4e43-938f-b68ea03300ab None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:19.179740 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:19.186500 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c74b62-7310-4e98-94cd-99894de4554c None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:19.187407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c74b62-7310-4e98-94cd-99894de4554c None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:19.187407 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c74b62-7310-4e98-94cd-99894de4554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:19.209621 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-65c74b62-7310-4e98-94cd-99894de4554c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:19.210835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-65c74b62-7310-4e98-94cd-99894de4554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:19.219099 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:19.568961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ba0f-eb2e-4e43-938f-b68ea03300ab None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:19.585584 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ba0f-eb2e-4e43-938f-b68ea03300ab None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:19.590854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8110c3f-cc19-4785-8055-667e1401ac66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:19.591458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8110c3f-cc19-4785-8055-667e1401ac66 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:19.591735 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8110c3f-cc19-4785-8055-667e1401ac66 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:19.592001 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8110c3f-cc19-4785-8055-667e1401ac66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:19.600646 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8110c3f-cc19-4785-8055-667e1401ac66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:19.602362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8110c3f-cc19-4785-8055-667e1401ac66 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:19.612288 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 516/1033] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:20.595050 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897035-692a-4fc9-817c-eb8f1d2d2bd1 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:20.595680 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897035-692a-4fc9-817c-eb8f1d2d2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:20.595680 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897035-692a-4fc9-817c-eb8f1d2d2bd1 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:20.596984 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:20.603170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c57e5-06b6-4e03-b74a-f38dd9d83be0 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:20.603694 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c57e5-06b6-4e03-b74a-f38dd9d83be0 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:20.603825 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c57e5-06b6-4e03-b74a-f38dd9d83be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:20.626561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-5d7c57e5-06b6-4e03-b74a-f38dd9d83be0 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:20.627771 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-5d7c57e5-06b6-4e03-b74a-f38dd9d83be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:20.636890 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:45:20.861302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1897035-692a-4fc9-817c-eb8f1d2d2bd1 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:20.875764 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1897035-692a-4fc9-817c-eb8f1d2d2bd1 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:20.881370 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d3383-493c-49b7-bad6-e9e8caaf5e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:20.881990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3383-493c-49b7-bad6-e9e8caaf5e0c service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:20.882569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3383-493c-49b7-bad6-e9e8caaf5e0c service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:20.882833 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3383-493c-49b7-bad6-e9e8caaf5e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:20.892581 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d3383-493c-49b7-bad6-e9e8caaf5e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:20.894305 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d3383-493c-49b7-bad6-e9e8caaf5e0c service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:20.905980 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 519/1036] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:22.057114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0b6e-9870-4365-9c38-3b15f1d085b7 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:22.057746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0b6e-9870-4365-9c38-3b15f1d085b7 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:22.057746 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0b6e-9870-4365-9c38-3b15f1d085b7 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:22.059027 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:22.065025 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe7d-8f04-4d8d-8e70-624ff4e22569 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:22.065713 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe7d-8f04-4d8d-8e70-624ff4e22569 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:22.065986 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe7d-8f04-4d8d-8e70-624ff4e22569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:22.090390 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-9b95fe7d-8f04-4d8d-8e70-624ff4e22569 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:22.091603 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-9b95fe7d-8f04-4d8d-8e70-624ff4e22569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:22.100897 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:45:22.261897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0b6e-9870-4365-9c38-3b15f1d085b7 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:22.281125 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0b6e-9870-4365-9c38-3b15f1d085b7 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:22.296794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1156678-33c0-4abc-aee0-35ebed7bab77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:22.297483 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156678-33c0-4abc-aee0-35ebed7bab77 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:22.297795 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156678-33c0-4abc-aee0-35ebed7bab77 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:22.298064 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156678-33c0-4abc-aee0-35ebed7bab77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:22.310043 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1156678-33c0-4abc-aee0-35ebed7bab77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:22.311586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1156678-33c0-4abc-aee0-35ebed7bab77 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:22.322306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 519/1039] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:23.238415 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4639346-01a6-4cd3-8c75-144330d1c33d None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:23.239281 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4639346-01a6-4cd3-8c75-144330d1c33d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:23.239281 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4639346-01a6-4cd3-8c75-144330d1c33d None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:23.240363 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:23.247194 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ed5d2-3608-4b83-9e4e-48016c370a0f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:23.248044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ed5d2-3608-4b83-9e4e-48016c370a0f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:23.248044 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ed5d2-3608-4b83-9e4e-48016c370a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:23.274504 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-834ed5d2-3608-4b83-9e4e-48016c370a0f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:23.276262 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-834ed5d2-3608-4b83-9e4e-48016c370a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:23.287421 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:23.463324 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4639346-01a6-4cd3-8c75-144330d1c33d None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:23.487568 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4639346-01a6-4cd3-8c75-144330d1c33d None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:23.494638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e0446-3059-473c-b9a5-8439e5fd9838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:23.495183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e0446-3059-473c-b9a5-8439e5fd9838 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:23.495452 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e0446-3059-473c-b9a5-8439e5fd9838 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:23.495728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e0446-3059-473c-b9a5-8439e5fd9838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:23.505073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e0446-3059-473c-b9a5-8439e5fd9838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:23.506779 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e0446-3059-473c-b9a5-8439e5fd9838 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:23.518520 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 522/1042] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:24.473599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9adef-fdd8-4215-9801-4408e35d24e7 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:24.474531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9adef-fdd8-4215-9801-4408e35d24e7 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:24.474531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9adef-fdd8-4215-9801-4408e35d24e7 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:24.476792 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:24.483310 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08a86-4d1e-45dc-b6d6-d1c0e6fbc198 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:24.483757 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08a86-4d1e-45dc-b6d6-d1c0e6fbc198 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:24.483881 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08a86-4d1e-45dc-b6d6-d1c0e6fbc198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:24.512851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-3fa08a86-4d1e-45dc-b6d6-d1c0e6fbc198 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:24.514019 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-3fa08a86-4d1e-45dc-b6d6-d1c0e6fbc198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:24.523204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:24.686710 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9adef-fdd8-4215-9801-4408e35d24e7 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:24.706944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9adef-fdd8-4215-9801-4408e35d24e7 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:24.715069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63964e8-d1a6-4d5a-9071-d8e5d8b5a24b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:24.715673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63964e8-d1a6-4d5a-9071-d8e5d8b5a24b service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:24.715944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63964e8-d1a6-4d5a-9071-d8e5d8b5a24b service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:24.716209 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63964e8-d1a6-4d5a-9071-d8e5d8b5a24b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:24.725154 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63964e8-d1a6-4d5a-9071-d8e5d8b5a24b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:24.726776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63964e8-d1a6-4d5a-9071-d8e5d8b5a24b service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:24.741324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 522/1045] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:25.569213 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906466-3895-4b5d-891e-6d9ba51067d7 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:25.569807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906466-3895-4b5d-891e-6d9ba51067d7 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:25.569807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906466-3895-4b5d-891e-6d9ba51067d7 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:25.571316 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:25.577021 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d212a-70f8-46b4-999c-b7967668a977 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:25.577566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d212a-70f8-46b4-999c-b7967668a977 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:25.577566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d212a-70f8-46b4-999c-b7967668a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:25.599067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-fb4d212a-70f8-46b4-999c-b7967668a977 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:25.600272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-fb4d212a-70f8-46b4-999c-b7967668a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:25.609611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:25.774558 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906466-3895-4b5d-891e-6d9ba51067d7 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:25.799481 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906466-3895-4b5d-891e-6d9ba51067d7 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:25.808429 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59d333-0e30-4a31-bb80-697d4a8c8e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:25.809047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d333-0e30-4a31-bb80-697d4a8c8e34 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:25.809357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d333-0e30-4a31-bb80-697d4a8c8e34 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:25.809617 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d333-0e30-4a31-bb80-697d4a8c8e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:25.819572 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59d333-0e30-4a31-bb80-697d4a8c8e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:25.821168 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59d333-0e30-4a31-bb80-697d4a8c8e34 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:25.831520 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 525/1048] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:26.666577 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175acb27-a9d0-4461-b7ca-3296ddd6b267 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:26.667455 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175acb27-a9d0-4461-b7ca-3296ddd6b267 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:26.667455 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175acb27-a9d0-4461-b7ca-3296ddd6b267 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:26.671371 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:26.678364 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549dfb-357e-4272-9f51-fbf0d45f9f78 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:26.679146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549dfb-357e-4272-9f51-fbf0d45f9f78 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:26.679357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549dfb-357e-4272-9f51-fbf0d45f9f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:26.704973 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-ac549dfb-357e-4272-9f51-fbf0d45f9f78 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:26.706234 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-ac549dfb-357e-4272-9f51-fbf0d45f9f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:26.718505 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:26.886576 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175acb27-a9d0-4461-b7ca-3296ddd6b267 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:26.911104 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175acb27-a9d0-4461-b7ca-3296ddd6b267 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:26.917748 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5bc07-0b0e-4277-989a-8ecb9b81ff58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:26.918273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bc07-0b0e-4277-989a-8ecb9b81ff58 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:26.918665 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bc07-0b0e-4277-989a-8ecb9b81ff58 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:26.918932 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bc07-0b0e-4277-989a-8ecb9b81ff58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:26.927339 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5bc07-0b0e-4277-989a-8ecb9b81ff58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:26.928956 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5bc07-0b0e-4277-989a-8ecb9b81ff58 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:26.938785 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 525/1051] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:27.772391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99a04-c2c4-49f6-af32-3d170fd2bcf6 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:27.772961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99a04-c2c4-49f6-af32-3d170fd2bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:27.772961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99a04-c2c4-49f6-af32-3d170fd2bcf6 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:27.774628 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:45:27.782857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d050-f400-4420-bf55-40c01e02c64c None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:27.783580 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d050-f400-4420-bf55-40c01e02c64c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:27.783775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d050-f400-4420-bf55-40c01e02c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:27.812732 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d316d050-f400-4420-bf55-40c01e02c64c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:27.813960 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d316d050-f400-4420-bf55-40c01e02c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:27.823547 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:27.981185 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99a04-c2c4-49f6-af32-3d170fd2bcf6 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:28.000724 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99a04-c2c4-49f6-af32-3d170fd2bcf6 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:28.006748 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac204b-aab0-4f10-8690-b15f802eb676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:28.007713 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac204b-aab0-4f10-8690-b15f802eb676 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:28.007984 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac204b-aab0-4f10-8690-b15f802eb676 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:28.008487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac204b-aab0-4f10-8690-b15f802eb676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:28.017563 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac204b-aab0-4f10-8690-b15f802eb676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:28.019206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac204b-aab0-4f10-8690-b15f802eb676 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:28.029336 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 528/1054] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:28.862895 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49afc59-5b1e-46b2-9a73-cac82321f8db None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:28.863478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49afc59-5b1e-46b2-9a73-cac82321f8db None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:28.863478 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49afc59-5b1e-46b2-9a73-cac82321f8db None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:28.865599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:45:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:28.871860 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bcc5-aae3-48ed-b658-db5db61fd3ae None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:28.872321 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bcc5-aae3-48ed-b658-db5db61fd3ae None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:28.872417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bcc5-aae3-48ed-b658-db5db61fd3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:28.899556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b0c4bcc5-aae3-48ed-b658-db5db61fd3ae None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:28.900784 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b0c4bcc5-aae3-48ed-b658-db5db61fd3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:28.909970 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:45:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:29.073473 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49afc59-5b1e-46b2-9a73-cac82321f8db None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:29.094539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49afc59-5b1e-46b2-9a73-cac82321f8db None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:29.102666 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1673e-0bcd-44b6-8367-ad6a9071709e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:29.103292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1673e-0bcd-44b6-8367-ad6a9071709e service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:29.103526 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1673e-0bcd-44b6-8367-ad6a9071709e service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:29.103801 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1673e-0bcd-44b6-8367-ad6a9071709e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:29.112306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1673e-0bcd-44b6-8367-ad6a9071709e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:29.113996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1673e-0bcd-44b6-8367-ad6a9071709e service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:29.123417 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 528/1057] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:31.200788 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ecf06-c009-4d20-9fcd-fbf4c4e7078f None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:31.201418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ecf06-c009-4d20-9fcd-fbf4c4e7078f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:31.201418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ecf06-c009-4d20-9fcd-fbf4c4e7078f None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:31.202835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:31.210897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5109e-7961-4dae-9a1a-2dc8931b7533 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:31.211416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5109e-7961-4dae-9a1a-2dc8931b7533 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:31.211416 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5109e-7961-4dae-9a1a-2dc8931b7533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:31.235884 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-34a5109e-7961-4dae-9a1a-2dc8931b7533 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:31.237129 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-34a5109e-7961-4dae-9a1a-2dc8931b7533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:31.246900 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:45:31.585928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ecf06-c009-4d20-9fcd-fbf4c4e7078f None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:31.598218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ecf06-c009-4d20-9fcd-fbf4c4e7078f None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:31.602286 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c405e-4e3c-434f-87a9-653aa9c579a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:31.602863 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c405e-4e3c-434f-87a9-653aa9c579a9 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:31.603154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c405e-4e3c-434f-87a9-653aa9c579a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:31.603415 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c405e-4e3c-434f-87a9-653aa9c579a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:31.613127 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c405e-4e3c-434f-87a9-653aa9c579a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:31.615197 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c405e-4e3c-434f-87a9-653aa9c579a9 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:31.626565 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 531/1060] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:33.999353 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61914ea-2427-459e-bfa2-8a5e55773c84 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:33.999942 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61914ea-2427-459e-bfa2-8a5e55773c84 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:33.999942 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61914ea-2427-459e-bfa2-8a5e55773c84 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:34.001281 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:45:34.008017 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813d42-c26c-4082-a5fe-c9669640fe91 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:34.008987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813d42-c26c-4082-a5fe-c9669640fe91 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:34.008987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813d42-c26c-4082-a5fe-c9669640fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:34.034591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-f1813d42-c26c-4082-a5fe-c9669640fe91 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:34.035770 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-f1813d42-c26c-4082-a5fe-c9669640fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:34.045493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:45:34.399859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61914ea-2427-459e-bfa2-8a5e55773c84 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:34.417477 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61914ea-2427-459e-bfa2-8a5e55773c84 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:34.421776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a4ebf-1c12-4b55-9375-18f531e0fde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:34.422364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a4ebf-1c12-4b55-9375-18f531e0fde6 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:34.422636 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a4ebf-1c12-4b55-9375-18f531e0fde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:34.422896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a4ebf-1c12-4b55-9375-18f531e0fde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:34.433531 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a4ebf-1c12-4b55-9375-18f531e0fde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:34.434957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a4ebf-1c12-4b55-9375-18f531e0fde6 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:34.444516 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 531/1063] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:37.024687 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb48e-a9f0-46d8-9797-acf2146242dd None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:37.025271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb48e-a9f0-46d8-9797-acf2146242dd None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:37.025271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb48e-a9f0-46d8-9797-acf2146242dd None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:37.026511 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:37.035512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fbc1e-4730-4dd1-a1e9-faafe0d079f4 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:37.035964 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fbc1e-4730-4dd1-a1e9-faafe0d079f4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:37.036062 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fbc1e-4730-4dd1-a1e9-faafe0d079f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:37.062640 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d60fbc1e-4730-4dd1-a1e9-faafe0d079f4 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:37.063881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d60fbc1e-4730-4dd1-a1e9-faafe0d079f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:37.073615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:37.412753 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfb48e-a9f0-46d8-9797-acf2146242dd None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:37.431351 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfb48e-a9f0-46d8-9797-acf2146242dd None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:37.435480 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280ce3-a1ef-47ac-b295-f96156ba7a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:37.436077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280ce3-a1ef-47ac-b295-f96156ba7a7a service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:37.436346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280ce3-a1ef-47ac-b295-f96156ba7a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:37.436608 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280ce3-a1ef-47ac-b295-f96156ba7a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:37.446815 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280ce3-a1ef-47ac-b295-f96156ba7a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:37.448248 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280ce3-a1ef-47ac-b295-f96156ba7a7a service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:37.458029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 534/1066] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:39.769720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a283ae-2f3b-46af-b1a3-3e4092e9b6d5 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:39.770315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a283ae-2f3b-46af-b1a3-3e4092e9b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:39.770315 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a283ae-2f3b-46af-b1a3-3e4092e9b6d5 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:39.771642 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:39.778656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152af9e-9574-4e23-951c-7d942a6c6405 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:39.779113 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152af9e-9574-4e23-951c-7d942a6c6405 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:39.779206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152af9e-9574-4e23-951c-7d942a6c6405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:39.808048 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-d152af9e-9574-4e23-951c-7d942a6c6405 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:39.809318 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-d152af9e-9574-4e23-951c-7d942a6c6405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:39.818254 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:40.187001 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a283ae-2f3b-46af-b1a3-3e4092e9b6d5 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:40.203509 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a283ae-2f3b-46af-b1a3-3e4092e9b6d5 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:40.209818 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01165b-52a6-47be-82ab-2ff723b3c092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:40.210627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01165b-52a6-47be-82ab-2ff723b3c092 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:40.211090 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01165b-52a6-47be-82ab-2ff723b3c092 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:40.211523 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01165b-52a6-47be-82ab-2ff723b3c092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:40.227029 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01165b-52a6-47be-82ab-2ff723b3c092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:40.228545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01165b-52a6-47be-82ab-2ff723b3c092 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:40.242283 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 534/1069] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:45:42.560121 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897c154-534c-483d-8ccf-ca34fb686d9e None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:42.560690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897c154-534c-483d-8ccf-ca34fb686d9e None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:42.560690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897c154-534c-483d-8ccf-ca34fb686d9e None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:42.562032 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:45:42.568496 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a0e6-78c2-4bfc-8305-a013b917109e None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:42.569291 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a0e6-78c2-4bfc-8305-a013b917109e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:42.569448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a0e6-78c2-4bfc-8305-a013b917109e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:42.599332 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-9151a0e6-78c2-4bfc-8305-a013b917109e None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:42.601274 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-9151a0e6-78c2-4bfc-8305-a013b917109e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:42.610821 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:42.960534 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897c154-534c-483d-8ccf-ca34fb686d9e None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:42.973253 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897c154-534c-483d-8ccf-ca34fb686d9e None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:42.982064 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a9c5-fe5b-4eb5-a6a1-849cb1d904b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:42.982670 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a9c5-fe5b-4eb5-a6a1-849cb1d904b8 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:42.982941 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a9c5-fe5b-4eb5-a6a1-849cb1d904b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:42.983204 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a9c5-fe5b-4eb5-a6a1-849cb1d904b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:42.996057 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64a9c5-fe5b-4eb5-a6a1-849cb1d904b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:42.997589 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64a9c5-fe5b-4eb5-a6a1-849cb1d904b8 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:43.008189 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 537/1072] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:45.361005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ce3d-192a-4968-8336-049609be7955 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:45.361991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ce3d-192a-4968-8336-049609be7955 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:45.361991 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ce3d-192a-4968-8336-049609be7955 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:45.364138 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:45.371120 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaa7b1-e8a6-4774-becc-7e8990989c60 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:45.371760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaa7b1-e8a6-4774-becc-7e8990989c60 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:45.371760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaa7b1-e8a6-4774-becc-7e8990989c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:45.381731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=70 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:45.398152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-9ceaa7b1-e8a6-4774-becc-7e8990989c60 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:45.400164 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-9ceaa7b1-e8a6-4774-becc-7e8990989c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:45.410339 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:45.762187 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ce3d-192a-4968-8336-049609be7955 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:45.768036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=64 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:45.775885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ce3d-192a-4968-8336-049609be7955 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:45.779609 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae215-e10b-42e8-a785-f0b734361be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:45.780207 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae215-e10b-42e8-a785-f0b734361be2 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:45.780476 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae215-e10b-42e8-a785-f0b734361be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:45.780729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae215-e10b-42e8-a785-f0b734361be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:45.790907 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae215-e10b-42e8-a785-f0b734361be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:45.792440 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae215-e10b-42e8-a785-f0b734361be2 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:45.802744 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 537/1075] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:48.056599 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09eea-3ac3-4143-9855-2ad40125d96e None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:48.057501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09eea-3ac3-4143-9855-2ad40125d96e None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:48.057501 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09eea-3ac3-4143-9855-2ad40125d96e None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:48.059645 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:48.065401 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a393-761d-4270-a128-7c527d2cf7f2 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:48.065868 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a393-761d-4270-a128-7c527d2cf7f2 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:48.065963 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a393-761d-4270-a128-7c527d2cf7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:48.089667 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-2e31a393-761d-4270-a128-7c527d2cf7f2 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:48.090920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-2e31a393-761d-4270-a128-7c527d2cf7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:48.099233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:48.458197 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09eea-3ac3-4143-9855-2ad40125d96e None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:48.477337 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09eea-3ac3-4143-9855-2ad40125d96e None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:48.482548 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7888fd-9a3a-499a-ba70-5c6092c33a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:48.483142 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7888fd-9a3a-499a-ba70-5c6092c33a57 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:48.483412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7888fd-9a3a-499a-ba70-5c6092c33a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:48.483688 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7888fd-9a3a-499a-ba70-5c6092c33a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:48.494307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7888fd-9a3a-499a-ba70-5c6092c33a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:48.495732 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7888fd-9a3a-499a-ba70-5c6092c33a57 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:48.505699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 540/1078] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:50.779245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7371d-0270-4c27-8cdb-ba775f37e822 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:50.779832 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7371d-0270-4c27-8cdb-ba775f37e822 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:50.779832 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7371d-0270-4c27-8cdb-ba775f37e822 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:50.781120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:50.787391 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c746b-5298-47a7-a971-11bf05984b12 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:50.787832 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c746b-5298-47a7-a971-11bf05984b12 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:50.787934 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c746b-5298-47a7-a971-11bf05984b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:50.816765 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-a19c746b-5298-47a7-a971-11bf05984b12 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:50.818519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-a19c746b-5298-47a7-a971-11bf05984b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:50.828285 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:51.174972 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7371d-0270-4c27-8cdb-ba775f37e822 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:51.189163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7371d-0270-4c27-8cdb-ba775f37e822 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:51.193169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9ce99-3565-4cd2-9d4e-299c6ce55fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:51.193784 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9ce99-3565-4cd2-9d4e-299c6ce55fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:51.194054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9ce99-3565-4cd2-9d4e-299c6ce55fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:51.194310 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9ce99-3565-4cd2-9d4e-299c6ce55fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:51.204804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9ce99-3565-4cd2-9d4e-299c6ce55fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:51.206282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9ce99-3565-4cd2-9d4e-299c6ce55fd8 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:51.216968 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 540/1081] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:53.525237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981e63-3b9f-4f8d-86d6-0b1e83e380b1 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:53.525942 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981e63-3b9f-4f8d-86d6-0b1e83e380b1 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:53.525942 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981e63-3b9f-4f8d-86d6-0b1e83e380b1 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:53.527074 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:53.534152 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef800e-8ecc-4818-aa15-40a8547e1b6e None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:53.534918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef800e-8ecc-4818-aa15-40a8547e1b6e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:53.534918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef800e-8ecc-4818-aa15-40a8547e1b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:53.556485 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-e2ef800e-8ecc-4818-aa15-40a8547e1b6e None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:53.557750 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-e2ef800e-8ecc-4818-aa15-40a8547e1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:53.567122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:53.907339 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981e63-3b9f-4f8d-86d6-0b1e83e380b1 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:53.922047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981e63-3b9f-4f8d-86d6-0b1e83e380b1 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:53.926056 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5ac6-2e22-412f-9086-5b51171a3388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:53.926656 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5ac6-2e22-412f-9086-5b51171a3388 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:53.926928 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5ac6-2e22-412f-9086-5b51171a3388 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:53.927196 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5ac6-2e22-412f-9086-5b51171a3388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:53.937858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d5ac6-2e22-412f-9086-5b51171a3388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:53.939296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d5ac6-2e22-412f-9086-5b51171a3388 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:53.950175 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 543/1084] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:56.217972 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1b4a-fcfb-4b03-a2ad-a2b7c3825baf None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:56.218569 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1b4a-fcfb-4b03-a2ad-a2b7c3825baf None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:56.218569 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1b4a-fcfb-4b03-a2ad-a2b7c3825baf None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:56.219843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:56.226733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c60c-4eb6-4718-8157-4d17615b1e42 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:56.227369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c60c-4eb6-4718-8157-4d17615b1e42 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:56.227508 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c60c-4eb6-4718-8157-4d17615b1e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:56.253285 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-5584c60c-4eb6-4718-8157-4d17615b1e42 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:56.254512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-5584c60c-4eb6-4718-8157-4d17615b1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:56.264148 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:45:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:56.614001 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb1b4a-fcfb-4b03-a2ad-a2b7c3825baf None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:56.632893 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb1b4a-fcfb-4b03-a2ad-a2b7c3825baf None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:56.637341 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82cb03-4c06-4310-b857-501f466aec17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:56.637901 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82cb03-4c06-4310-b857-501f466aec17 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:56.638196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82cb03-4c06-4310-b857-501f466aec17 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:56.638459 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82cb03-4c06-4310-b857-501f466aec17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:56.648218 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82cb03-4c06-4310-b857-501f466aec17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:56.650014 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82cb03-4c06-4310-b857-501f466aec17 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:56.659630 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 543/1087] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:06.247981 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=20 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:06.655405 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=23 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:20.895400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22345-74fa-4445-bd13-352219f85516 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:20.896475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22345-74fa-4445-bd13-352219f85516 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:20.896475 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22345-74fa-4445-bd13-352219f85516 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:20.898474 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 545/1088] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:46:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:20.906446 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6493-0015-4c8c-b297-c2a5e853048f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:20.906924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6493-0015-4c8c-b297-c2a5e853048f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:20.907046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6493-0015-4c8c-b297-c2a5e853048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:20.930300 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-99ea6493-0015-4c8c-b297-c2a5e853048f None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:20.931623 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-99ea6493-0015-4c8c-b297-c2a5e853048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:20.940898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 544/1089] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:46:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:21.306210 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a3ba-51f4-4b1a-b4c3-69bccae04b39 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:21.306487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a3ba-51f4-4b1a-b4c3-69bccae04b39 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:21.306780 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a3ba-51f4-4b1a-b4c3-69bccae04b39 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:21.308105 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 546/1090] 10.222.0.50 () {54 vars in 967 bytes} [Mon Aug 22 20:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:21.314576 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6263-445e-45be-9a3b-1c28aaf4d16d None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:21.314944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6263-445e-45be-9a3b-1c28aaf4d16d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:21.315272 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6263-445e-45be-9a3b-1c28aaf4d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:21.345139 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-25cb6263-445e-45be-9a3b-1c28aaf4d16d None None] MFA Rules not processed for user `68490ffb61b54cc78d3104049f0e03ae`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:21.346940 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-25cb6263-445e-45be-9a3b-1c28aaf4d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:21.356407 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 545/1091] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Aug 22 20:46:21 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:21.364091 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95a3ba-51f4-4b1a-b4c3-69bccae04b39 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:21.376367 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95a3ba-51f4-4b1a-b4c3-69bccae04b39 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:21.380433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a104b-b491-4fbd-8d8e-0462c51f2930 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68490ffb61b54cc78d3104049f0e03ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:21.381045 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a104b-b491-4fbd-8d8e-0462c51f2930 service glance] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:21.381381 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a104b-b491-4fbd-8d8e-0462c51f2930 service glance] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:21.381652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a104b-b491-4fbd-8d8e-0462c51f2930 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:21.391345 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a104b-b491-4fbd-8d8e-0462c51f2930 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:21.392756 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a104b-b491-4fbd-8d8e-0462c51f2930 service glance] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:21.403166 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 547/1092] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:23.719105 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54af95-d96b-4446-9974-83e06edba3fd None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:23.719676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54af95-d96b-4446-9974-83e06edba3fd None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:23.719676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54af95-d96b-4446-9974-83e06edba3fd None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:23.721910 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 546/1093] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:46:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:23.728222 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd5182-eeb8-4f1d-8d53-118fd01e6234 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:23.728685 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd5182-eeb8-4f1d-8d53-118fd01e6234 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:23.728801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd5182-eeb8-4f1d-8d53-118fd01e6234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:23.753608 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-cecd5182-eeb8-4f1d-8d53-118fd01e6234 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:23.754876 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-cecd5182-eeb8-4f1d-8d53-118fd01e6234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:23.769012 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 548/1094] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:46:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:24.111385 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54af95-d96b-4446-9974-83e06edba3fd None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:24.129182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54af95-d96b-4446-9974-83e06edba3fd None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:24.134219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a41dea-f026-4e8f-9bb6-2e5c87ec1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:24.134833 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41dea-f026-4e8f-9bb6-2e5c87ec1778 admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:24.135105 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41dea-f026-4e8f-9bb6-2e5c87ec1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:24.135370 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41dea-f026-4e8f-9bb6-2e5c87ec1778 admin admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:24.136082 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a41dea-f026-4e8f-9bb6-2e5c87ec1778 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:24.137973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-54a41dea-f026-4e8f-9bb6-2e5c87ec1778 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:24.137973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 20:46:24.137973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 20:46:24.139164 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a41dea-f026-4e8f-9bb6-2e5c87ec1778 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:24.161412 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 547/1095] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 22 20:46:24 2022] GET /identity/v3/projects => generated 1606 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:46:26.412370 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba721-e77d-4577-b99c-3502376172f0 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:26.412989 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba721-e77d-4577-b99c-3502376172f0 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:26.412989 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba721-e77d-4577-b99c-3502376172f0 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:26.414356 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 549/1096] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:26.423510 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b9ac4-c6a1-4b07-8327-796d99a37369 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:26.424260 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b9ac4-c6a1-4b07-8327-796d99a37369 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:26.424581 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b9ac4-c6a1-4b07-8327-796d99a37369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:26.447288 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-ea6b9ac4-c6a1-4b07-8327-796d99a37369 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:26.448493 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-ea6b9ac4-c6a1-4b07-8327-796d99a37369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:26.457165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 548/1097] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:46:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:26.804246 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ba721-e77d-4577-b99c-3502376172f0 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:26.824996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ba721-e77d-4577-b99c-3502376172f0 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:26.830232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6208d28-eeef-477c-8d90-779dfc734f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:26.831183 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208d28-eeef-477c-8d90-779dfc734f55 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:26.831536 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208d28-eeef-477c-8d90-779dfc734f55 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:26.831740 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208d28-eeef-477c-8d90-779dfc734f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:26.841063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6208d28-eeef-477c-8d90-779dfc734f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:26.842697 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6208d28-eeef-477c-8d90-779dfc734f55 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:26.853255 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 550/1098] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:29.313961 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69c5c9-40e1-4757-b608-b31f292a8868 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:29.314561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69c5c9-40e1-4757-b608-b31f292a8868 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:29.314561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69c5c9-40e1-4757-b608-b31f292a8868 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:29.315831 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 549/1099] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:29.322350 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bdbc2-4f7f-4806-9c61-aec4fbcd64b6 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:29.323160 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bdbc2-4f7f-4806-9c61-aec4fbcd64b6 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:29.323320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bdbc2-4f7f-4806-9c61-aec4fbcd64b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:29.354062 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e49bdbc2-4f7f-4806-9c61-aec4fbcd64b6 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:29.355980 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e49bdbc2-4f7f-4806-9c61-aec4fbcd64b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:29.369119 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 551/1100] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:46:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:29.712099 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69c5c9-40e1-4757-b608-b31f292a8868 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:29.724358 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69c5c9-40e1-4757-b608-b31f292a8868 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:29.728611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9775f-131f-43f3-8ced-39d9b5b53a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:29.729244 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9775f-131f-43f3-8ced-39d9b5b53a8e service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:29.729509 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9775f-131f-43f3-8ced-39d9b5b53a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:29.729769 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9775f-131f-43f3-8ced-39d9b5b53a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:29.739603 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9775f-131f-43f3-8ced-39d9b5b53a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:29.741123 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9775f-131f-43f3-8ced-39d9b5b53a8e service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:29.751340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 550/1101] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:32.010610 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2869-edbd-4450-9e70-4172147403c2 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:32.011464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2869-edbd-4450-9e70-4172147403c2 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:32.011464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2869-edbd-4450-9e70-4172147403c2 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:32.013546 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 552/1102] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:46:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:32.022215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8718373-2c60-46ca-9d7b-19909c0c4c42 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:32.022790 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8718373-2c60-46ca-9d7b-19909c0c4c42 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:32.022960 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8718373-2c60-46ca-9d7b-19909c0c4c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:32.050119 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d8718373-2c60-46ca-9d7b-19909c0c4c42 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:32.051325 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d8718373-2c60-46ca-9d7b-19909c0c4c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:32.061006 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 551/1103] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:46:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:32.409538 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab2869-edbd-4450-9e70-4172147403c2 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:32.429805 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab2869-edbd-4450-9e70-4172147403c2 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:32.434569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9222a-acaa-4172-9da4-748e1584a10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:32.435166 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9222a-acaa-4172-9da4-748e1584a10e service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:32.435436 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9222a-acaa-4172-9da4-748e1584a10e service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:32.435699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9222a-acaa-4172-9da4-748e1584a10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:32.447111 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9222a-acaa-4172-9da4-748e1584a10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:32.448535 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9222a-acaa-4172-9da4-748e1584a10e service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:32.458704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 553/1104] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:34.864410 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edda82-5dad-4d5b-997b-b0d23960c57f None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:34.865378 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edda82-5dad-4d5b-997b-b0d23960c57f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:34.865378 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edda82-5dad-4d5b-997b-b0d23960c57f None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:34.867415 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 552/1105] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:46:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:34.876573 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30469dd-0513-4005-9cc5-18b5bc42ca3d None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:34.877030 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30469dd-0513-4005-9cc5-18b5bc42ca3d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:34.877158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30469dd-0513-4005-9cc5-18b5bc42ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:34.899859 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-c30469dd-0513-4005-9cc5-18b5bc42ca3d None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:34.900989 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-c30469dd-0513-4005-9cc5-18b5bc42ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:34.911333 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 554/1106] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:46:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:35.265794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edda82-5dad-4d5b-997b-b0d23960c57f None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:35.281926 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edda82-5dad-4d5b-997b-b0d23960c57f None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:35.286128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2312a6-4f76-4241-80e8-420e68617553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:35.286729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2312a6-4f76-4241-80e8-420e68617553 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:35.286996 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2312a6-4f76-4241-80e8-420e68617553 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:35.287261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2312a6-4f76-4241-80e8-420e68617553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:35.297963 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2312a6-4f76-4241-80e8-420e68617553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:35.299408 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2312a6-4f76-4241-80e8-420e68617553 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:35.309182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 553/1107] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:37.721380 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a01ce-3728-45a0-93de-e7bd7463a250 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:37.722133 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a01ce-3728-45a0-93de-e7bd7463a250 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:37.722244 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a01ce-3728-45a0-93de-e7bd7463a250 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:37.724302 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 555/1108] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 22 20:46:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:37.730082 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9388-bc7f-4d4a-8cca-f9b68263dc26 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:37.730578 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9388-bc7f-4d4a-8cca-f9b68263dc26 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:37.730578 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9388-bc7f-4d4a-8cca-f9b68263dc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:37.757196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-a86a9388-bc7f-4d4a-8cca-f9b68263dc26 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:37.758831 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-a86a9388-bc7f-4d4a-8cca-f9b68263dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:37.768560 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 554/1109] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 22 20:46:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:38.109689 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a01ce-3728-45a0-93de-e7bd7463a250 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:38.122568 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a01ce-3728-45a0-93de-e7bd7463a250 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:38.126704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f77927-8ce0-4e4d-8875-fc8e413606a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:38.127346 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77927-8ce0-4e4d-8875-fc8e413606a0 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:38.127618 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77927-8ce0-4e4d-8875-fc8e413606a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:38.127886 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77927-8ce0-4e4d-8875-fc8e413606a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:38.139113 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77927-8ce0-4e4d-8875-fc8e413606a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:38.140577 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77927-8ce0-4e4d-8875-fc8e413606a0 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:38.150631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 556/1110] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:47.749049 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=33 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:48.146118 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=33 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:53.723639 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545f86-ed25-4e3a-89e8-efef449e9bce None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:53.724559 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545f86-ed25-4e3a-89e8-efef449e9bce None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:53.724559 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545f86-ed25-4e3a-89e8-efef449e9bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:53.753397 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-37545f86-ed25-4e3a-89e8-efef449e9bce None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:53.754647 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-37545f86-ed25-4e3a-89e8-efef449e9bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:53.764076 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 555/1111] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:47:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:53.773961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f3266-d257-4abb-9b9a-13ccde635864 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:53.774519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f3266-d257-4abb-9b9a-13ccde635864 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:53.774519 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f3266-d257-4abb-9b9a-13ccde635864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:53.796591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-376f3266-d257-4abb-9b9a-13ccde635864 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:53.797823 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-376f3266-d257-4abb-9b9a-13ccde635864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:53.806442 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 557/1112] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:47:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:47:53.812941 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545f86-ed25-4e3a-89e8-efef449e9bce None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:53.823125 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545f86-ed25-4e3a-89e8-efef449e9bce None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:53.828731 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:53.829355 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:53.829627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:53.829892 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:53.830524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:47:53.830822 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:53.831829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:53.831829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 20:47:53.831829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 20:47:53.832714 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:53.844597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 556/1113] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 22 20:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:47:53.853964 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f3266-d257-4abb-9b9a-13ccde635864 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:53.867839 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f3266-d257-4abb-9b9a-13ccde635864 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:53.875448 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:53.876055 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:53.876328 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:53.876601 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:53.877263 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:53.879150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING py.warnings [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:53.879150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: warnings.warn(msg) Aug 22 20:47:53.879150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: Aug 22 20:47:53.880387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:53.911826 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 558/1114] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 22 20:47:53 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:47:53.916194 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:53.927184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec945e-a938-4d7c-ab94-796621fe1d88 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:53.989440 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:53.990160 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:53.990532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:53.990863 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:53.991758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:53.993318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:53.993318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 20:47:53.993318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 20:47:53.995114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:54.021393 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 557/1115] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:47:53 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:47:54.026309 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:54.037662 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a86799-9d7c-4bfe-8feb-ba0e95b768c8 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:54.042926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:54.043514 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.043815 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.044075 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.044701 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:54.046063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING py.warnings [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:54.046063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: warnings.warn(msg) Aug 22 20:47:54.046063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: Aug 22 20:47:54.046989 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:54.063493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 559/1116] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:47:54.068013 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:54.080299 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fdd5e-87a7-4928-9435-7849d9e3754c admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:54.085475 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c98414-c25e-4681-9284-9ba0b26d5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:54.086079 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c98414-c25e-4681-9284-9ba0b26d5cae admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.086349 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c98414-c25e-4681-9284-9ba0b26d5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.086613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c98414-c25e-4681-9284-9ba0b26d5cae admin admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.087250 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c98414-c25e-4681-9284-9ba0b26d5cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:54.088259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-19c98414-c25e-4681-9284-9ba0b26d5cae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:54.088259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 20:47:54.088259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 20:47:54.089167 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c98414-c25e-4681-9284-9ba0b26d5cae admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:54.104470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 558/1117] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:47:54.109594 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:54.124922 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450c284-f6b9-4c85-9757-e0138796e9cc admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:54.131999 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c3563-4558-4ca2-8cd7-9aaec4af0fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:54.133005 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3563-4558-4ca2-8cd7-9aaec4af0fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.133498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3563-4558-4ca2-8cd7-9aaec4af0fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.133929 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3563-4558-4ca2-8cd7-9aaec4af0fbc admin admin] PATH_INFO: `/v3/projects/7d79232e17b64956b0fc89e62d4583a0/users/b84047067b464d3d9c67207c91825388/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.153522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c3563-4558-4ca2-8cd7-9aaec4af0fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d79232e17b64956b0fc89e62d4583a0, user_id=b84047067b464d3d9c67207c91825388, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:54.154812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING py.warnings [None req-8c5c3563-4558-4ca2-8cd7-9aaec4af0fbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:54.154812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: warnings.warn(msg) Aug 22 20:47:54.154812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: Aug 22 20:47:54.156974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c3563-4558-4ca2-8cd7-9aaec4af0fbc admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:54.175440 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 560/1118] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 22 20:47:54 2022] PUT /identity/v3/projects/7d79232e17b64956b0fc89e62d4583a0/users/b84047067b464d3d9c67207c91825388/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:47:54.188867 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857693-8310-4137-846b-b977078bf3b4 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.189151 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857693-8310-4137-846b-b977078bf3b4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.189463 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857693-8310-4137-846b-b977078bf3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.222950 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-24857693-8310-4137-846b-b977078bf3b4 None None] MFA Rules not processed for user `b84047067b464d3d9c67207c91825388`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:54.224170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-24857693-8310-4137-846b-b977078bf3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:54.294418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 559/1119] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:47:54 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:54.309637 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea120-e8d7-4aea-9585-023c27043c12 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.309923 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea120-e8d7-4aea-9585-023c27043c12 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.310198 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea120-e8d7-4aea-9585-023c27043c12 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.311553 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 561/1120] 10.222.0.50 () {54 vars in 964 bytes} [Mon Aug 22 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:54.317882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2317e-1469-442c-a492-2c14d182252f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.318232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2317e-1469-442c-a492-2c14d182252f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.318523 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2317e-1469-442c-a492-2c14d182252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.342196 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-11d2317e-1469-442c-a492-2c14d182252f None None] MFA Rules not processed for user `2e0c0dc1360a4dce928cbc27eab76ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:54.343654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-11d2317e-1469-442c-a492-2c14d182252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:54.387425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:54.396535 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 560/1121] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Aug 22 20:47:54 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:54.404959 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea120-e8d7-4aea-9585-023c27043c12 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:54.418154 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea120-e8d7-4aea-9585-023c27043c12 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:54.422626 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e0c0dc1360a4dce928cbc27eab76ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:54.423219 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.423493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.423760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.432498 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:54.433989 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:54.444320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 562/1122] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:54 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:54.487489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46013c-dea4-491f-b8bb-b3be7a4f8658 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.487775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46013c-dea4-491f-b8bb-b3be7a4f8658 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.488053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46013c-dea4-491f-b8bb-b3be7a4f8658 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.489374 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 561/1123] 10.222.0.50 () {52 vars in 830 bytes} [Mon Aug 22 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:54.493366 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:54.562257 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc726-72dd-4bf9-b933-c3d839d1858a service cinder] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:54.567464 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:54.568083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.568357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.568616 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] PATH_INFO: `/v3/users/b84047067b464d3d9c67207c91825388` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.570023 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84047067b464d3d9c67207c91825388)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:54.571056 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING py.warnings [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:54.571056 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: warnings.warn(msg) Aug 22 20:47:54.571056 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: Aug 22 20:47:54.572257 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:54.646262 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84047067b464d3d9c67207c91825388'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:54.661924 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84047067b464d3d9c67207c91825388'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:54.662932 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84047067b464d3d9c67207c91825388'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:54.663654 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84047067b464d3d9c67207c91825388'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:54.689508 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84047067b464d3d9c67207c91825388'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:54.709369 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 563/1124] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 22 20:47:54 2022] DELETE /identity/v3/users/b84047067b464d3d9c67207c91825388 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:47:54.715804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.716176 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.716545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.736307 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:54.737569 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:54.808800 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 562/1125] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:47:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:54.819291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:54.821776 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:54.829852 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:54.891630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259ad2f-ab2c-48b6-a20d-01ef65d23fbf admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:54.896129 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d4a90-0d06-4dc5-8cd9-96368d76def2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:54.896731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4a90-0d06-4dc5-8cd9-96368d76def2 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:54.897003 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4a90-0d06-4dc5-8cd9-96368d76def2 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:54.897294 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4a90-0d06-4dc5-8cd9-96368d76def2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:54.907911 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d4a90-0d06-4dc5-8cd9-96368d76def2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:54.909419 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d4a90-0d06-4dc5-8cd9-96368d76def2 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:54.922111 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 564/1126] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:55.287160 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:55.288578 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:55.300526 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd3bfb-605c-4d03-9788-6d68f8c03b19 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:55.305518 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:55.306292 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:55.306567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:55.306831 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] PATH_INFO: `/v3/projects/7d79232e17b64956b0fc89e62d4583a0` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:55.308046 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d79232e17b64956b0fc89e62d4583a0)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:55.309149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:47:55.309149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 20:47:55.309149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 20:47:55.310362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:55.374178 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d79232e17b64956b0fc89e62d4583a0', 'request_id': 'req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:55.387897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d79232e17b64956b0fc89e62d4583a0', 'request_id': 'req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:55.394436 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d79232e17b64956b0fc89e62d4583a0', 'request_id': 'req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:55.409597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] The token cache is being invalidate because project 7d79232e17b64956b0fc89e62d4583a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:47:55.409852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:55.410612 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-0a4a8bdc-bd65-44d1-b5f1-58f987df5498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:47:55.412144 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 563/1127] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 22 20:47:55 2022] DELETE /identity/v3/projects/7d79232e17b64956b0fc89e62d4583a0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:48:04.914978 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=25 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:48:05.406556 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:22.875235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9891dc-0774-4a6e-9666-2c1e77346c97 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:22.875900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9891dc-0774-4a6e-9666-2c1e77346c97 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:22.875900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9891dc-0774-4a6e-9666-2c1e77346c97 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:22.877151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:22.884586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc5b1-f6d6-49df-903d-7d6c817207df None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:22.885069 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc5b1-f6d6-49df-903d-7d6c817207df None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:22.885216 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc5b1-f6d6-49df-903d-7d6c817207df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:22.958387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-69dcc5b1-f6d6-49df-903d-7d6c817207df None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:22.959708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-69dcc5b1-f6d6-49df-903d-7d6c817207df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:23.068114 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:23.235661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9891dc-0774-4a6e-9666-2c1e77346c97 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.237837 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-3b9891dc-0774-4a6e-9666-2c1e77346c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:23.338443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9891dc-0774-4a6e-9666-2c1e77346c97 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.344469 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302872a-81a1-4a56-9ae4-4b4327be0410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.345073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302872a-81a1-4a56-9ae4-4b4327be0410 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.345381 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302872a-81a1-4a56-9ae4-4b4327be0410 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.345647 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302872a-81a1-4a56-9ae4-4b4327be0410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.354911 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302872a-81a1-4a56-9ae4-4b4327be0410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.356513 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302872a-81a1-4a56-9ae4-4b4327be0410 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.366433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 566/1130] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:24.271592 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6d63-ac1d-4047-911e-ce46acc59edc None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:24.272106 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6d63-ac1d-4047-911e-ce46acc59edc None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:24.272106 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6d63-ac1d-4047-911e-ce46acc59edc None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:24.273541 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:24.280711 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02f0b3-397a-4d69-9dfd-00404f4c930a None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:24.281226 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02f0b3-397a-4d69-9dfd-00404f4c930a None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:24.281226 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02f0b3-397a-4d69-9dfd-00404f4c930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:24.302054 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-0b02f0b3-397a-4d69-9dfd-00404f4c930a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:24.303808 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-0b02f0b3-397a-4d69-9dfd-00404f4c930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:24.313996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:49:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:24.478557 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf6d63-ac1d-4047-911e-ce46acc59edc None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:24.493843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf6d63-ac1d-4047-911e-ce46acc59edc None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:24.499212 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ec833-0d70-4420-bbaf-b9dc0ae865e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:24.499804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ec833-0d70-4420-bbaf-b9dc0ae865e1 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:24.500075 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ec833-0d70-4420-bbaf-b9dc0ae865e1 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:24.500340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ec833-0d70-4420-bbaf-b9dc0ae865e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:24.509735 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ec833-0d70-4420-bbaf-b9dc0ae865e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:24.511336 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ec833-0d70-4420-bbaf-b9dc0ae865e1 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:24.521776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 566/1133] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:28.999449 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd8cd-6b90-4b16-9241-b8ab0cb49231 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:29.000098 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd8cd-6b90-4b16-9241-b8ab0cb49231 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:29.000098 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd8cd-6b90-4b16-9241-b8ab0cb49231 None None] PATH_INFO: `/v3` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:29.001288 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 568/1134] 10.222.0.72 () {54 vars in 925 bytes} [Mon Aug 22 20:49:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:49:29.013163 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec8240-cb8e-4281-af27-6fd27afc1b94 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:29.013936 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec8240-cb8e-4281-af27-6fd27afc1b94 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:29.014054 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec8240-cb8e-4281-af27-6fd27afc1b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:29.047828 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-e6ec8240-cb8e-4281-af27-6fd27afc1b94 None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:29.049032 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-e6ec8240-cb8e-4281-af27-6fd27afc1b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:29.107111 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:29.117977 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 567/1135] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 22 20:49:29 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:34.297060 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=42 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:35.799851 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613efd7a-b4cb-4967-a90b-1d72b4de8da1 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:35.800584 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613efd7a-b4cb-4967-a90b-1d72b4de8da1 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:35.800584 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613efd7a-b4cb-4967-a90b-1d72b4de8da1 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:35.802375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 569/1136] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:35.810508 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c4cb-60fe-44d5-80f5-0d233b08486c None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:35.810968 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c4cb-60fe-44d5-80f5-0d233b08486c None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:35.811077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c4cb-60fe-44d5-80f5-0d233b08486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:35.837400 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-1e78c4cb-60fe-44d5-80f5-0d233b08486c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:35.838593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-1e78c4cb-60fe-44d5-80f5-0d233b08486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:35.849192 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 568/1137] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:49:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:36.013112 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613efd7a-b4cb-4967-a90b-1d72b4de8da1 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:36.027241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613efd7a-b4cb-4967-a90b-1d72b4de8da1 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:36.032505 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280ae2-6a76-40b8-871a-c9f99aab02cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:36.033121 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280ae2-6a76-40b8-871a-c9f99aab02cb service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:36.033399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280ae2-6a76-40b8-871a-c9f99aab02cb service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:36.033663 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280ae2-6a76-40b8-871a-c9f99aab02cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:36.042338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280ae2-6a76-40b8-871a-c9f99aab02cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:36.043926 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280ae2-6a76-40b8-871a-c9f99aab02cb service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:36.053669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 570/1138] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:36.890783 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2f5b2-4cc5-48dd-bbf8-0b01e8f9cd71 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:36.891468 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2f5b2-4cc5-48dd-bbf8-0b01e8f9cd71 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:36.891468 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2f5b2-4cc5-48dd-bbf8-0b01e8f9cd71 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:36.893766 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:49:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:36.901990 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2c1b-2626-45b8-9188-0db89460fe2c None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:36.902455 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2c1b-2626-45b8-9188-0db89460fe2c None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:36.902564 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2c1b-2626-45b8-9188-0db89460fe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:36.925236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-345e2c1b-2626-45b8-9188-0db89460fe2c None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:36.926437 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-345e2c1b-2626-45b8-9188-0db89460fe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:36.935478 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:49:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:37.104333 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2f5b2-4cc5-48dd-bbf8-0b01e8f9cd71 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:37.124669 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2f5b2-4cc5-48dd-bbf8-0b01e8f9cd71 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:37.130644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224712ff-3e43-4d75-9e55-58f6d5237ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:37.131259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224712ff-3e43-4d75-9e55-58f6d5237ea0 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:37.131532 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224712ff-3e43-4d75-9e55-58f6d5237ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:37.131775 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224712ff-3e43-4d75-9e55-58f6d5237ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:37.140465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224712ff-3e43-4d75-9e55-58f6d5237ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:37.142227 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224712ff-3e43-4d75-9e55-58f6d5237ea0 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:37.151899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 570/1141] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:38.583550 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292088ba-3220-481e-91c6-1d8da95e5ad0 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:38.584374 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292088ba-3220-481e-91c6-1d8da95e5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:38.584374 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292088ba-3220-481e-91c6-1d8da95e5ad0 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:38.586372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 572/1142] 10.222.0.50 () {54 vars in 961 bytes} [Mon Aug 22 20:49:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:38.591601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c55f-e736-48c6-af0b-707d58a7f1ac None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:38.592066 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c55f-e736-48c6-af0b-707d58a7f1ac None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:38.592170 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c55f-e736-48c6-af0b-707d58a7f1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:38.612132 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-ba67c55f-e736-48c6-af0b-707d58a7f1ac None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:38.613362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-ba67c55f-e736-48c6-af0b-707d58a7f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:38.622807 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 571/1143] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Aug 22 20:49:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:38.630690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292088ba-3220-481e-91c6-1d8da95e5ad0 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:38.646682 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292088ba-3220-481e-91c6-1d8da95e5ad0 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:38.651995 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc189-e86a-49be-877f-182977a9fbae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:38.652584 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc189-e86a-49be-877f-182977a9fbae service placement] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:38.652857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc189-e86a-49be-877f-182977a9fbae service placement] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:38.653152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc189-e86a-49be-877f-182977a9fbae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:38.662265 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc189-e86a-49be-877f-182977a9fbae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:38.663937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc189-e86a-49be-877f-182977a9fbae service placement] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:38.674195 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 573/1144] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:38 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:48.430174 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076638-6d17-4e8e-a5d5-de7d00b29543 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:48.430779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076638-6d17-4e8e-a5d5-de7d00b29543 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:48.430779 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076638-6d17-4e8e-a5d5-de7d00b29543 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:48.432028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:48.439880 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a26f7-69ff-4082-b421-8e3587246844 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:48.440582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a26f7-69ff-4082-b421-8e3587246844 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:48.440582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a26f7-69ff-4082-b421-8e3587246844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:48.465235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-9c7a26f7-69ff-4082-b421-8e3587246844 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:48.466436 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-9c7a26f7-69ff-4082-b421-8e3587246844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:48.476109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:49:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:48.607148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=12 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:48.642471 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5076638-6d17-4e8e-a5d5-de7d00b29543 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:48.657891 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5076638-6d17-4e8e-a5d5-de7d00b29543 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:48.664543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35beda54-71c6-4ea5-ae5d-9882a8386117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:48.665131 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beda54-71c6-4ea5-ae5d-9882a8386117 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:48.665437 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beda54-71c6-4ea5-ae5d-9882a8386117 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:48.665682 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beda54-71c6-4ea5-ae5d-9882a8386117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:48.674876 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35beda54-71c6-4ea5-ae5d-9882a8386117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:48.676483 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35beda54-71c6-4ea5-ae5d-9882a8386117 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:48.686149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 573/1147] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:49.545583 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0063b-3fad-4785-ac12-196769fb664e None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:49.546383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0063b-3fad-4785-ac12-196769fb664e None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:49.546383 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0063b-3fad-4785-ac12-196769fb664e None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:49.548252 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:49:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:49.554430 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b43f4-a8dd-44e1-be41-490e23aa1bce None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:49.555169 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b43f4-a8dd-44e1-be41-490e23aa1bce None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:49.555342 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b43f4-a8dd-44e1-be41-490e23aa1bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:49.578394 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-2e2b43f4-a8dd-44e1-be41-490e23aa1bce None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:49.579596 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-2e2b43f4-a8dd-44e1-be41-490e23aa1bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:49.587898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:49:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:49.750620 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0063b-3fad-4785-ac12-196769fb664e None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:49.768277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0063b-3fad-4785-ac12-196769fb664e None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:49.780111 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531ca85-00d6-4ee4-9c15-25581fe3f433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:49.780922 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ca85-00d6-4ee4-9c15-25581fe3f433 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:49.781253 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ca85-00d6-4ee4-9c15-25581fe3f433 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:49.782241 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ca85-00d6-4ee4-9c15-25581fe3f433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:49.792496 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531ca85-00d6-4ee4-9c15-25581fe3f433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:49.794134 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531ca85-00d6-4ee4-9c15-25581fe3f433 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:49.805314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 576/1150] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:53.912709 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3010b-6acd-4ac3-b0d3-c27a4583dbd9 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:53.913384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3010b-6acd-4ac3-b0d3-c27a4583dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:53.913384 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3010b-6acd-4ac3-b0d3-c27a4583dbd9 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:53.914665 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:53.921150 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364507d-0359-42a9-a789-e74f45bb1a60 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:53.922352 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364507d-0359-42a9-a789-e74f45bb1a60 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:53.922791 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364507d-0359-42a9-a789-e74f45bb1a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:53.954247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-4364507d-0359-42a9-a789-e74f45bb1a60 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:53.955517 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-4364507d-0359-42a9-a789-e74f45bb1a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:53.965485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:49:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:54.315267 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3010b-6acd-4ac3-b0d3-c27a4583dbd9 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:54.317398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-fae3010b-6acd-4ac3-b0d3-c27a4583dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:54.399914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3010b-6acd-4ac3-b0d3-c27a4583dbd9 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:54.404150 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0411-29b6-4a70-860f-36add49da953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:54.404761 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0411-29b6-4a70-860f-36add49da953 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:54.405036 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0411-29b6-4a70-860f-36add49da953 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:54.405341 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0411-29b6-4a70-860f-36add49da953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:54.414866 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0411-29b6-4a70-860f-36add49da953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:54.416318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0411-29b6-4a70-860f-36add49da953 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:54.426182 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 576/1153] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:56.652271 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3ada-c269-49cd-8815-4d0c3b3051d9 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.652880 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3ada-c269-49cd-8815-4d0c3b3051d9 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.652880 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3ada-c269-49cd-8815-4d0c3b3051d9 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.654199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:56.660547 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd8aba-51b6-4acd-a4e8-ba8267cbfada None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.661077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd8aba-51b6-4acd-a4e8-ba8267cbfada None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.661077 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd8aba-51b6-4acd-a4e8-ba8267cbfada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.682852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-cdbd8aba-51b6-4acd-a4e8-ba8267cbfada None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:56.684067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-cdbd8aba-51b6-4acd-a4e8-ba8267cbfada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:56.693281 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:49:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:57.044588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be3ada-c269-49cd-8815-4d0c3b3051d9 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:57.062591 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be3ada-c269-49cd-8815-4d0c3b3051d9 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:57.067085 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd0e33-5288-422b-9287-70513453eef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:57.067717 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd0e33-5288-422b-9287-70513453eef5 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:57.067986 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd0e33-5288-422b-9287-70513453eef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:57.068251 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd0e33-5288-422b-9287-70513453eef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:57.078908 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd0e33-5288-422b-9287-70513453eef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:57.080365 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd0e33-5288-422b-9287-70513453eef5 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:57.094227 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 579/1156] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:00.967978 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205618-76b2-4b2d-bd01-93b8a3822a67 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:00.968597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205618-76b2-4b2d-bd01-93b8a3822a67 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:00.968597 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205618-76b2-4b2d-bd01-93b8a3822a67 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:00.969924 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 578/1157] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:50:00.976394 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0fbf-0436-4af6-bdce-ce1e94f5c636 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:00.977085 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0fbf-0436-4af6-bdce-ce1e94f5c636 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:00.977218 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0fbf-0436-4af6-bdce-ce1e94f5c636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:01.002088 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-0d6f0fbf-0436-4af6-bdce-ce1e94f5c636 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:01.003320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-0d6f0fbf-0436-4af6-bdce-ce1e94f5c636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:01.013967 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 580/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:50:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:01.605249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b205618-76b2-4b2d-bd01-93b8a3822a67 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:01.608260 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-3b205618-76b2-4b2d-bd01-93b8a3822a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:01.690683 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b205618-76b2-4b2d-bd01-93b8a3822a67 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:01.695149 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c2a4c-f4d8-444e-9c16-0d016d08b298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e0c0dc1360a4dce928cbc27eab76ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:01.695943 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c2a4c-f4d8-444e-9c16-0d016d08b298 service cinder] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:01.696221 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c2a4c-f4d8-444e-9c16-0d016d08b298 service cinder] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:01.696489 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c2a4c-f4d8-444e-9c16-0d016d08b298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:01.707938 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c2a4c-f4d8-444e-9c16-0d016d08b298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:01.709618 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c2a4c-f4d8-444e-9c16-0d016d08b298 service cinder] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:01.719866 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 579/1159] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:03.949866 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72b8c-9320-467b-9a53-1598e84770e3 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:03.950483 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72b8c-9320-467b-9a53-1598e84770e3 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:03.950483 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72b8c-9320-467b-9a53-1598e84770e3 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:03.951766 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 581/1160] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:50:03.958153 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbf3ba-d525-48c6-8f24-3ea0717fa0d5 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:03.958678 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbf3ba-d525-48c6-8f24-3ea0717fa0d5 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:03.958678 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbf3ba-d525-48c6-8f24-3ea0717fa0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:03.980729 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-02fbf3ba-d525-48c6-8f24-3ea0717fa0d5 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:03.981944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-02fbf3ba-d525-48c6-8f24-3ea0717fa0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:03.990441 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 580/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:50:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:04.558432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f72b8c-9320-467b-9a53-1598e84770e3 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:04.561691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-95f72b8c-9320-467b-9a53-1598e84770e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:04.571146 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=37 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:04.578922 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f72b8c-9320-467b-9a53-1598e84770e3 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:04.583174 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963515-0c13-4f61-8503-6993621308a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e0c0dc1360a4dce928cbc27eab76ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:04.583804 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963515-0c13-4f61-8503-6993621308a8 service cinder] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:04.584077 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963515-0c13-4f61-8503-6993621308a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:04.584331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963515-0c13-4f61-8503-6993621308a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:04.594515 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1963515-0c13-4f61-8503-6993621308a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:04.595936 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1963515-0c13-4f61-8503-6993621308a8 service cinder] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:04.605459 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 582/1162] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:13.975903 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=77 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:14.601314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=5 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:19.837524 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97ea1-2c4b-413e-96d8-b7889c8a5da4 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:19.838232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97ea1-2c4b-413e-96d8-b7889c8a5da4 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:19.838232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97ea1-2c4b-413e-96d8-b7889c8a5da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:19.858819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-10a97ea1-2c4b-413e-96d8-b7889c8a5da4 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:19.860217 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-10a97ea1-2c4b-413e-96d8-b7889c8a5da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:19.868519 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 581/1163] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:19.870253 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ba8e-6c78-496e-9572-cf325ce068ad None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:19.870814 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ba8e-6c78-496e-9572-cf325ce068ad None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:19.870946 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ba8e-6c78-496e-9572-cf325ce068ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:19.876526 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236b08-cffd-4334-89bf-4edf09db4b8a None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:19.876804 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236b08-cffd-4334-89bf-4edf09db4b8a None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:19.877048 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236b08-cffd-4334-89bf-4edf09db4b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:19.893473 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-9930ba8e-6c78-496e-9572-cf325ce068ad None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:19.894708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-9930ba8e-6c78-496e-9572-cf325ce068ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:19.896440 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-5e236b08-cffd-4334-89bf-4edf09db4b8a None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:19.897627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-5e236b08-cffd-4334-89bf-4edf09db4b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:19.903718 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 583/1164] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:19.905574 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 582/1165] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:51:19.910040 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930ba8e-6c78-496e-9572-cf325ce068ad None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:19.912350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b41a-44f8-4024-9eb5-331a118db35e None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:19.912642 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b41a-44f8-4024-9eb5-331a118db35e None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:19.912897 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b41a-44f8-4024-9eb5-331a118db35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:19.920167 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930ba8e-6c78-496e-9572-cf325ce068ad None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:19.926109 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:19.926720 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:19.926987 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:19.927247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] PATH_INFO: `/v3/domains` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:19.927879 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:51:19.928176 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:19.929215 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING py.warnings [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:51:19.929215 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: warnings.warn(msg) Aug 22 20:51:19.929215 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: Aug 22 20:51:19.930120 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:19.932716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-7923b41a-44f8-4024-9eb5-331a118db35e None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:19.933976 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-7923b41a-44f8-4024-9eb5-331a118db35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:19.942259 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 583/1166] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:51:19.949192 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 584/1167] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 22 20:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:51:19.949369 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923b41a-44f8-4024-9eb5-331a118db35e None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:19.951042 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:19.956935 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923b41a-44f8-4024-9eb5-331a118db35e None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:19.961298 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05143d7-79c8-4e5c-a800-cc2d254e6973 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:19.962118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:19.962736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:19.963015 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:19.963282 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] PATH_INFO: `/v3/domains` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:19.963960 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:51:19.964261 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:19.965954 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:19.966067 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:19.966552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:19.966823 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:19.967085 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:19.967770 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:19.969731 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:19.978727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 584/1168] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 22 20:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:51:19.987128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:19.996974 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff79b6-355f-4ef1-aaeb-aa0d5896366b admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.002240 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.003128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.003372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.003646 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.004320 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.005324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:51:20.005324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 20:51:20.005324 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 20:51:20.006530 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.010687 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 585/1169] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 22 20:51:19 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:51:20.014681 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.034889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 585/1170] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 22 20:51:19 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:51:20.039175 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.081353 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81125-8e84-4cbb-9d23-b909016d83c7 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.102615 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7601ad-2408-4c11-a97b-a67f779550e2 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.107250 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.107862 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.108228 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.108594 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.109276 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.111198 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.133399 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 586/1171] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:51:20 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:51:20.137462 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.140235 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.140920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.141307 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.141580 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.142199 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.143237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING py.warnings [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:51:20.143237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: warnings.warn(msg) Aug 22 20:51:20.143237 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: Aug 22 20:51:20.144503 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.147536 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ede70-a0b6-4fce-a4e0-d2e477f65b49 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.152326 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.152918 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.153256 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.153842 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.154158 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.156148 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.166865 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 586/1172] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:51:20 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:51:20.169814 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 587/1173] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:51:20.170855 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.171002 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.180904 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05b026-ba81-4f32-bedb-2a1dbc3cd073 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.181567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941cc6d-65b2-4711-847e-2a283e1641ac admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.185960 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.186593 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.186771 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.186887 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.187105 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.187215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.187467 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.187736 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.187849 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.188372 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.189397 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.190003 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.200079 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 587/1174] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:51:20.200382 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 588/1175] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:51:20.204444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.205122 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.214631 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851fcf-ad75-4535-aa0f-36b2b76acc3b admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.214958 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09431e70-288a-4fde-a1b0-c05df8af90ab admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.220673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65a93a-bc6a-43e2-80e3-f7e0833c4503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.221512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a93a-bc6a-43e2-80e3-f7e0833c4503 admin admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.221655 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a93a-bc6a-43e2-80e3-f7e0833c4503 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.221858 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.222011 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a93a-bc6a-43e2-80e3-f7e0833c4503 admin admin] PATH_INFO: `/v3/projects/a523a47573f142c989948d6f970cd0ae/users/8d4ad9cedd824a3d81f4c07f8b067da1/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.223933 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.224210 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.224481 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.226432 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.228049 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.241213 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 588/1176] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:51:20.244508 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.246854 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65a93a-bc6a-43e2-80e3-f7e0833c4503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a523a47573f142c989948d6f970cd0ae, user_id=8d4ad9cedd824a3d81f4c07f8b067da1, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.247889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-af65a93a-bc6a-43e2-80e3-f7e0833c4503 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:51:20.247889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 20:51:20.247889 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 20:51:20.250019 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65a93a-bc6a-43e2-80e3-f7e0833c4503 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.255947 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0d90-9a87-41f0-bc31-49664dd48831 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.262103 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f348db-1b5a-4c13-a14c-3f1fef3929cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.262760 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f348db-1b5a-4c13-a14c-3f1fef3929cc admin admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.263033 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f348db-1b5a-4c13-a14c-3f1fef3929cc admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.263300 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f348db-1b5a-4c13-a14c-3f1fef3929cc admin admin] PATH_INFO: `/v3/projects/5830abb52b114b1980bc46b03ae3976d/users/37365503c68446fb98fab52166b542df/roles/ecb9b0fc60ff48f4aec62bb80c281b54` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.270318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 589/1177] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 22 20:51:20 2022] PUT /identity/v3/projects/a523a47573f142c989948d6f970cd0ae/users/8d4ad9cedd824a3d81f4c07f8b067da1/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:51:20.272088 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c080ef-0334-424c-9afd-23404d6d9221 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.272364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c080ef-0334-424c-9afd-23404d6d9221 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.272627 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c080ef-0334-424c-9afd-23404d6d9221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.279247 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f348db-1b5a-4c13-a14c-3f1fef3929cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5830abb52b114b1980bc46b03ae3976d, user_id=37365503c68446fb98fab52166b542df, role_id=ecb9b0fc60ff48f4aec62bb80c281b54)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.282106 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f348db-1b5a-4c13-a14c-3f1fef3929cc admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.291757 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-70c080ef-0334-424c-9afd-23404d6d9221 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:20.292387 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:20.293084 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-70c080ef-0334-424c-9afd-23404d6d9221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:20.297889 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 589/1178] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 22 20:51:20 2022] PUT /identity/v3/projects/5830abb52b114b1980bc46b03ae3976d/users/37365503c68446fb98fab52166b542df/roles/ecb9b0fc60ff48f4aec62bb80c281b54 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:51:20.303169 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4d67a-9d87-4c98-97d0-91894f978f75 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.303483 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4d67a-9d87-4c98-97d0-91894f978f75 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.303872 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4d67a-9d87-4c98-97d0-91894f978f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.323625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-63d4d67a-9d87-4c98-97d0-91894f978f75 None None] MFA Rules not processed for user `cce5922f39ab43c1aa73a41f5fc3c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:20.324836 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-63d4d67a-9d87-4c98-97d0-91894f978f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:20.337281 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:20.354762 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 590/1179] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:51:20.366118 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c080ef-0334-424c-9afd-23404d6d9221 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.387870 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 590/1180] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:51:20.398431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4d67a-9d87-4c98-97d0-91894f978f75 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.423498 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c080ef-0334-424c-9afd-23404d6d9221 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.427199 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7348d-90bc-47e1-8e19-591cd0522944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.427801 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7348d-90bc-47e1-8e19-591cd0522944 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.428076 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7348d-90bc-47e1-8e19-591cd0522944 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.428338 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7348d-90bc-47e1-8e19-591cd0522944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.437652 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7348d-90bc-47e1-8e19-591cd0522944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.439070 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7348d-90bc-47e1-8e19-591cd0522944 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.448604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 591/1181] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:20.454444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4d67a-9d87-4c98-97d0-91894f978f75 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.458063 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41fce-3ca8-4421-a1de-e5acf38d0085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.458674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41fce-3ca8-4421-a1de-e5acf38d0085 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.459320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41fce-3ca8-4421-a1de-e5acf38d0085 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.459320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41fce-3ca8-4421-a1de-e5acf38d0085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.469348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a41fce-3ca8-4421-a1de-e5acf38d0085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.470801 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a41fce-3ca8-4421-a1de-e5acf38d0085 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.480839 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 591/1182] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:25.883039 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ac8d-531c-4060-b370-023fe86c9c8f None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:25.883573 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ac8d-531c-4060-b370-023fe86c9c8f None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:25.884536 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ac8d-531c-4060-b370-023fe86c9c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:25.930708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef177-e0d8-46f1-a73c-d6f80210c3d5 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:25.931280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef177-e0d8-46f1-a73c-d6f80210c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:25.931280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef177-e0d8-46f1-a73c-d6f80210c3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:25.948052 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-dfc9ac8d-531c-4060-b370-023fe86c9c8f None None] MFA Rules not processed for user `37365503c68446fb98fab52166b542df`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:25.949625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-dfc9ac8d-531c-4060-b370-023fe86c9c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:25.988723 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-abfef177-e0d8-46f1-a73c-d6f80210c3d5 None None] MFA Rules not processed for user `8d4ad9cedd824a3d81f4c07f8b067da1`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:25.990431 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-abfef177-e0d8-46f1-a73c-d6f80210c3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:26.043425 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 592/1183] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:25 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:26.052628 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9ac8d-531c-4060-b370-023fe86c9c8f None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.079724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9ac8d-531c-4060-b370-023fe86c9c8f None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.086796 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.087858 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.088357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.088839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] PATH_INFO: `/v3/projects` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.089829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.092289 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.129820 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 592/1184] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:25 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:26.130846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfef177-e0d8-46f1-a73c-d6f80210c3d5 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.131604 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 593/1185] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 22 20:51:26 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:51:26.135921 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.146809 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfef177-e0d8-46f1-a73c-d6f80210c3d5 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.185404 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:26.211986 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8961-c60d-4df9-82fd-64ce240cbeee admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.217065 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.217865 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.218071 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.218340 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] PATH_INFO: `/v3/users` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.218973 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.220954 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.227691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.229873 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:26.230735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.232342 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.233569 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] PATH_INFO: `/v3/projects` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.237614 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.240540 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.248751 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 594/1186] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:51:26 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:51:26.254418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.268829 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bfead-4ab3-46cb-a690-ca92d6887840 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.275376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.275902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.276486 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.276486 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.277222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.278998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 593/1187] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 22 20:51:26 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:51:26.283903 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.284946 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.299923 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 595/1188] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:51:26.304089 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.317329 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ecdc5-0711-4928-8a2b-3a8d1e0b60d6 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.391372 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515455-8615-4714-919d-1288eccaca96 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.394882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.395631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.396051 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.396443 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] PATH_INFO: `/v3/projects/700e3519d5b2440394ad5c0e7e0a4148/users/29a8faf9906b4268af108f5d786946a3/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.397179 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.397789 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.398069 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.398340 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] PATH_INFO: `/v3/users` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.398974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.401299 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.421870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=700e3519d5b2440394ad5c0e7e0a4148, user_id=29a8faf9906b4268af108f5d786946a3, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.426766 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.437389 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 594/1189] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 22 20:51:26 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:51:26.443465 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.450750 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 596/1190] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 22 20:51:26 2022] PUT /identity/v3/projects/700e3519d5b2440394ad5c0e7e0a4148/users/29a8faf9906b4268af108f5d786946a3/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:51:26.455843 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.456629 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1cfb4-547f-4504-b725-134ed7cdba65 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.551920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.552556 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.552882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.553479 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.553840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.555429 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.570285 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 595/1191] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:51:26.573788 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.576266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445f6b-146a-4630-bbe9-9cd7ce220c1d admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.589917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.590566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.590839 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.591110 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.591815 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.596396 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa989-db3e-4c5b-afe8-f5b0dbe3e515 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.598887 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.601860 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.602619 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] REQUEST_METHOD: `PUT` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.602961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.603300 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] PATH_INFO: `/v3/projects/2356c76f01424ec292facfbbd8fee066/users/ac161ebddcc648528b663967a439724a/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.612599 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 597/1192] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:51:26.616646 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.625255 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2356c76f01424ec292facfbbd8fee066, user_id=ac161ebddcc648528b663967a439724a, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.628482 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.630193 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afe55f-df88-4524-9327-04bd36c450f4 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.636235 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.637000 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.637356 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.637645 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] PATH_INFO: `/v3/projects/700e3519d5b2440394ad5c0e7e0a4148/users/29a8faf9906b4268af108f5d786946a3/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.640083 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=700e3519d5b2440394ad5c0e7e0a4148, user_id=29a8faf9906b4268af108f5d786946a3, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.643543 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.648042 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 596/1193] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 22 20:51:26 2022] PUT /identity/v3/projects/2356c76f01424ec292facfbbd8fee066/users/ac161ebddcc648528b663967a439724a/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:51:26.652026 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.660422 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 598/1194] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 22 20:51:26 2022] PUT /identity/v3/projects/700e3519d5b2440394ad5c0e7e0a4148/users/29a8faf9906b4268af108f5d786946a3/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:51:26.687277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:26.748428 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97e2b3-0fe9-412e-9dc3-21268452011d admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.874206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9171db-c935-406f-ac4d-b19e78c67735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.874678 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9171db-c935-406f-ac4d-b19e78c67735 admin admin] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.874966 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9171db-c935-406f-ac4d-b19e78c67735 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.875239 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9171db-c935-406f-ac4d-b19e78c67735 admin admin] PATH_INFO: `/v3/roles` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.875901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9171db-c935-406f-ac4d-b19e78c67735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.878021 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9171db-c935-406f-ac4d-b19e78c67735 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.896414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 597/1195] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 22 20:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:51:26.899195 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:26.916914 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67dc10-7855-4d91-8f23-d05d4d03bbfa admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:26.924003 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:26.924969 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:26.925388 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:26.925825 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] PATH_INFO: `/v3/projects/2356c76f01424ec292facfbbd8fee066/users/ac161ebddcc648528b663967a439724a/roles/5704f5205ad0422aaaf403ee517bd1a1` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:26.928314 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2356c76f01424ec292facfbbd8fee066, user_id=ac161ebddcc648528b663967a439724a, role_id=5704f5205ad0422aaaf403ee517bd1a1)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:26.931545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:26.949245 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 599/1196] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 22 20:51:26 2022] PUT /identity/v3/projects/2356c76f01424ec292facfbbd8fee066/users/ac161ebddcc648528b663967a439724a/roles/5704f5205ad0422aaaf403ee517bd1a1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:51:34.364430 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd647b9-53e1-462c-a74c-8ab9348fb7cd None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:34.364975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd647b9-53e1-462c-a74c-8ab9348fb7cd None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:34.364975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd647b9-53e1-462c-a74c-8ab9348fb7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:34.405211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-6dd647b9-53e1-462c-a74c-8ab9348fb7cd None None] MFA Rules not processed for user `ac161ebddcc648528b663967a439724a`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:34.406650 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-6dd647b9-53e1-462c-a74c-8ab9348fb7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:34.518111 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 598/1197] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:34 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:34.530350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:34.532145 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:34.587180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:34.647293 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad767-0acb-4624-9c80-1e173db2b6cf admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:34.654654 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68490ffb61b54cc78d3104049f0e03ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:34.655834 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:34.656474 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:34.656948 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:34.750350 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:34.751766 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:34.763558 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 600/1198] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:34 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:34.769144 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c678ce-f983-43e8-99b0-d54058e89f64 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:34.769306 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c678ce-f983-43e8-99b0-d54058e89f64 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:34.769568 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c678ce-f983-43e8-99b0-d54058e89f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:34.803331 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-c9c678ce-f983-43e8-99b0-d54058e89f64 None None] MFA Rules not processed for user `29a8faf9906b4268af108f5d786946a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:34.805676 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-c9c678ce-f983-43e8-99b0-d54058e89f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:34.856358 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:34.924206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 599/1199] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:34 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:34.925269 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:34.935344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf62339-d267-4689-95b6-dc4b53499442 service glance] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:34.943113 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d415c-d9f6-4c73-ac19-3661327cdc3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68490ffb61b54cc78d3104049f0e03ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:34.943881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d415c-d9f6-4c73-ac19-3661327cdc3c service glance] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:34.944222 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d415c-d9f6-4c73-ac19-3661327cdc3c service glance] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:34.944566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d415c-d9f6-4c73-ac19-3661327cdc3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:35.053591 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d415c-d9f6-4c73-ac19-3661327cdc3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:35.055404 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d415c-d9f6-4c73-ac19-3661327cdc3c service glance] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:35.084213 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 601/1200] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:34 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:43.002549 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b0c6-e84d-4ff5-bff8-d719391d8714 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:43.003158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b0c6-e84d-4ff5-bff8-d719391d8714 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:43.003158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b0c6-e84d-4ff5-bff8-d719391d8714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:43.025287 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-66e0b0c6-e84d-4ff5-bff8-d719391d8714 None None] MFA Rules not processed for user `8d4ad9cedd824a3d81f4c07f8b067da1`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:43.026945 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-66e0b0c6-e84d-4ff5-bff8-d719391d8714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:43.035561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 600/1201] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:51:43 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:43.338437 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff2bd-4842-423d-9518-370e23e2b1fa None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:43.339004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff2bd-4842-423d-9518-370e23e2b1fa None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:43.339004 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff2bd-4842-423d-9518-370e23e2b1fa None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:43.340362 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 602/1202] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 22 20:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:51:43.346277 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f113b3-37ed-4b69-9e7d-4d4b9921c976 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:43.346548 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f113b3-37ed-4b69-9e7d-4d4b9921c976 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:43.346811 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f113b3-37ed-4b69-9e7d-4d4b9921c976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:43.380877 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-37f113b3-37ed-4b69-9e7d-4d4b9921c976 None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:43.382107 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-37f113b3-37ed-4b69-9e7d-4d4b9921c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:43.450602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 601/1203] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 22 20:51:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:43.456998 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf159c-8c2f-4114-ae58-402991a2d5e3 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:43.457412 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf159c-8c2f-4114-ae58-402991a2d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:43.457739 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf159c-8c2f-4114-ae58-402991a2d5e3 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:43.459074 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 603/1204] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 22 20:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:51:43.465906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921574af-92f6-48d6-8acf-ea1d9bd18f78 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:43.466368 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921574af-92f6-48d6-8acf-ea1d9bd18f78 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:43.466699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921574af-92f6-48d6-8acf-ea1d9bd18f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:43.487919 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-921574af-92f6-48d6-8acf-ea1d9bd18f78 None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:43.489120 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-921574af-92f6-48d6-8acf-ea1d9bd18f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:43.498009 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 602/1205] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 22 20:51:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:51:43.510561 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf159c-8c2f-4114-ae58-402991a2d5e3 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:43.512264 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-16cf159c-8c2f-4114-ae58-402991a2d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:43.526210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf159c-8c2f-4114-ae58-402991a2d5e3 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:43.531930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03595003-3737-4e2f-9c63-81fa18e27ea8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68490ffb61b54cc78d3104049f0e03ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:43.531930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595003-3737-4e2f-9c63-81fa18e27ea8 service glance] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:43.532180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595003-3737-4e2f-9c63-81fa18e27ea8 service glance] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:43.532601 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595003-3737-4e2f-9c63-81fa18e27ea8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:43.546806 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03595003-3737-4e2f-9c63-81fa18e27ea8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:43.548295 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03595003-3737-4e2f-9c63-81fa18e27ea8 service glance] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:43.559509 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 604/1206] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:44.103231 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068290f-bc12-4ad6-9c7d-7632d9b18c09 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.104111 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068290f-bc12-4ad6-9c7d-7632d9b18c09 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.104340 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068290f-bc12-4ad6-9c7d-7632d9b18c09 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.107444 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 603/1207] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 22 20:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:51:44.116092 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29f9f-1d99-45b7-b947-a32453fa0739 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.116418 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29f9f-1d99-45b7-b947-a32453fa0739 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.116699 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29f9f-1d99-45b7-b947-a32453fa0739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.146392 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-e1f29f9f-1d99-45b7-b947-a32453fa0739 None None] MFA Rules not processed for user `f344891bb32f4d86ab3c2536c3a4ae68`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:44.147673 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-e1f29f9f-1d99-45b7-b947-a32453fa0739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:44.210584 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 605/1208] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 22 20:51:44 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:44.221522 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068290f-bc12-4ad6-9c7d-7632d9b18c09 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:44.224153 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-8068290f-bc12-4ad6-9c7d-7632d9b18c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:44.240303 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068290f-bc12-4ad6-9c7d-7632d9b18c09 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:44.245938 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7e566-d532-4b29-a85e-6204a9d1113d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:44.246765 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e566-d532-4b29-a85e-6204a9d1113d service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.247100 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e566-d532-4b29-a85e-6204a9d1113d service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.247600 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e566-d532-4b29-a85e-6204a9d1113d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.256892 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7e566-d532-4b29-a85e-6204a9d1113d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:44.258683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7e566-d532-4b29-a85e-6204a9d1113d service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:44.268191 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 604/1209] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:44 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:44.777232 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900275-abb7-46c6-b216-2881de8e4539 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.777852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900275-abb7-46c6-b216-2881de8e4539 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.777852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900275-abb7-46c6-b216-2881de8e4539 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.779706 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 606/1210] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 22 20:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:51:44.785910 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070586-b480-4df7-830d-50e35fc1efe1 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.786158 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070586-b480-4df7-830d-50e35fc1efe1 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.786433 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070586-b480-4df7-830d-50e35fc1efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.809486 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-4b070586-b480-4df7-830d-50e35fc1efe1 None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:44.811181 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-4b070586-b480-4df7-830d-50e35fc1efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:44.811334 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c88f1b-c765-42e7-8030-c41d22c4bcdc None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.812127 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c88f1b-c765-42e7-8030-c41d22c4bcdc None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.812740 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c88f1b-c765-42e7-8030-c41d22c4bcdc None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.814143 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 607/1211] 10.222.0.50 () {54 vars in 961 bytes} [Mon Aug 22 20:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:51:44.820866 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec90b-d3cf-4a1e-a7fd-e74a6f5faced None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.821126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec90b-d3cf-4a1e-a7fd-e74a6f5faced None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.821409 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec90b-d3cf-4a1e-a7fd-e74a6f5faced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.822053 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 605/1212] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 22 20:51:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:44.828231 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ba92-2db8-4d13-9f23-84c24d224f20 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.828717 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ba92-2db8-4d13-9f23-84c24d224f20 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.829088 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ba92-2db8-4d13-9f23-84c24d224f20 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.834919 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 606/1213] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 22 20:51:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:51:44.836206 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892c8f-5534-4d07-b52b-8e3e9783d99f None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.836586 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892c8f-5534-4d07-b52b-8e3e9783d99f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.836975 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892c8f-5534-4d07-b52b-8e3e9783d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.852998 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-a5eec90b-d3cf-4a1e-a7fd-e74a6f5faced None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:44.854658 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-a5eec90b-d3cf-4a1e-a7fd-e74a6f5faced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:44.859897 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-95892c8f-5534-4d07-b52b-8e3e9783d99f None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:44.861300 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-95892c8f-5534-4d07-b52b-8e3e9783d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:44.861724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=100 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:44.878940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 607/1214] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 22 20:51:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:44.893320 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95892c8f-5534-4d07-b52b-8e3e9783d99f None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:44.908898 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95892c8f-5534-4d07-b52b-8e3e9783d99f None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:44.914079 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:44.914905 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:44.915357 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:44.915636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:44.933882 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:44.935451 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:44.953036 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 608/1215] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:51:44.980782 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 608/1216] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Aug 22 20:51:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:44.989735 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:45.003470 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1b91-0a69-4670-ae10-c599e770380b service neutron] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:45.009757 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:45.010400 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:45.010733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:45.011001 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:45.013702 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:45.028317 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:45.030920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:45.045273 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 609/1217] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:44 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:54.966611 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=25 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:55.037842 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=76 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:56.775450 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4669854-5471-4ca3-92ae-da49a467b998 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:56.776067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4669854-5471-4ca3-92ae-da49a467b998 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:56.776067 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4669854-5471-4ca3-92ae-da49a467b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:56.798439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-f4669854-5471-4ca3-92ae-da49a467b998 None None] MFA Rules not processed for user `f344891bb32f4d86ab3c2536c3a4ae68`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:56.798439 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-f4669854-5471-4ca3-92ae-da49a467b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:56.805215 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 609/1218] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 22 20:51:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:56.817638 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:56.827682 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ae44-e2f8-4aa0-87c9-e603af02a1bc service placement] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:56.831572 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b892c-4409-4268-a5db-9eb3668aac12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:56.832163 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b892c-4409-4268-a5db-9eb3668aac12 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:56.832439 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b892c-4409-4268-a5db-9eb3668aac12 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:56.832704 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b892c-4409-4268-a5db-9eb3668aac12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:56.840027 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b892c-4409-4268-a5db-9eb3668aac12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:56.841844 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b892c-4409-4268-a5db-9eb3668aac12 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:56.850046 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 610/1219] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:56 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:57.795591 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452952-49a8-49a4-96a8-af63e62d3ce1 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:57.796233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452952-49a8-49a4-96a8-af63e62d3ce1 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:57.796233 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452952-49a8-49a4-96a8-af63e62d3ce1 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:57.797700 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 610/1220] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 20:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:51:57.818696 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9116d5-e93d-48a4-95f8-59bb425ddd2f None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:57.819276 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9116d5-e93d-48a4-95f8-59bb425ddd2f None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:57.819276 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9116d5-e93d-48a4-95f8-59bb425ddd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:57.840690 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-9c9116d5-e93d-48a4-95f8-59bb425ddd2f None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:57.842348 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-9c9116d5-e93d-48a4-95f8-59bb425ddd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:57.851503 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 611/1221] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 20:51:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:57.887402 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452952-49a8-49a4-96a8-af63e62d3ce1 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:57.904830 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452952-49a8-49a4-96a8-af63e62d3ce1 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:57.911268 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d501-0aae-4cb6-a51c-5c70347cb6d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:57.912205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d501-0aae-4cb6-a51c-5c70347cb6d6 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:57.912515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d501-0aae-4cb6-a51c-5c70347cb6d6 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:57.912758 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d501-0aae-4cb6-a51c-5c70347cb6d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:57.922795 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d501-0aae-4cb6-a51c-5c70347cb6d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:57.924825 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d501-0aae-4cb6-a51c-5c70347cb6d6 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:57.935957 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 611/1222] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:52:05.268795 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28468161-8683-4103-a1d5-25b7d9ccaa84 None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:05.269466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28468161-8683-4103-a1d5-25b7d9ccaa84 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:05.269466 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28468161-8683-4103-a1d5-25b7d9ccaa84 None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:05.270979 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 612/1223] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 20:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:52:05.278987 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683053-3cfb-4abe-b346-d28cb2c8111d None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:05.279539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683053-3cfb-4abe-b346-d28cb2c8111d None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:05.279539 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683053-3cfb-4abe-b346-d28cb2c8111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:05.302698 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-29683053-3cfb-4abe-b346-d28cb2c8111d None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:52:05.303902 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-29683053-3cfb-4abe-b346-d28cb2c8111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:52:05.313881 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 612/1224] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 20:52:05 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:52:05.328276 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28468161-8683-4103-a1d5-25b7d9ccaa84 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:52:05.344737 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28468161-8683-4103-a1d5-25b7d9ccaa84 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:52:05.351692 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242eaba-4151-49e1-8962-fd32ff2c422b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:52:05.352316 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242eaba-4151-49e1-8962-fd32ff2c422b service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:05.352590 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242eaba-4151-49e1-8962-fd32ff2c422b service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:05.352998 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242eaba-4151-49e1-8962-fd32ff2c422b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:05.362485 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242eaba-4151-49e1-8962-fd32ff2c422b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:52:05.364102 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242eaba-4151-49e1-8962-fd32ff2c422b service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:52:05.376152 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 613/1225] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:52:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:52:15.296644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=12 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:52:15.371460 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=15 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:52:18.871919 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683053-3cfb-4abe-b346-d28cb2c8111d None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:52:18.882716 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683053-3cfb-4abe-b346-d28cb2c8111d None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:52:18.886479 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94507-38f4-4844-a2ec-77db89662803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:52:18.887120 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94507-38f4-4844-a2ec-77db89662803 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:18.887398 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94507-38f4-4844-a2ec-77db89662803 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:18.887676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94507-38f4-4844-a2ec-77db89662803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:18.897663 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94507-38f4-4844-a2ec-77db89662803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:52:18.899459 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94507-38f4-4844-a2ec-77db89662803 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:52:18.912314 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 613/1226] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:52:18 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:52:28.906607 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=6 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:52:35.969566 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3393ba-77a9-4a6a-998c-24de1b88d834 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:35.970173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3393ba-77a9-4a6a-998c-24de1b88d834 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:35.970173 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3393ba-77a9-4a6a-998c-24de1b88d834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:35.998080 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-7a3393ba-77a9-4a6a-998c-24de1b88d834 None None] MFA Rules not processed for user `37365503c68446fb98fab52166b542df`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:52:35.999753 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-7a3393ba-77a9-4a6a-998c-24de1b88d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:52:36.009769 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 614/1227] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:52:35 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:52:45.989661 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:53:04.054569 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688ec5-4ac6-469f-a289-b0c5d77de8f6 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:04.055097 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688ec5-4ac6-469f-a289-b0c5d77de8f6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:04.055097 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688ec5-4ac6-469f-a289-b0c5d77de8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:04.077354 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-8e688ec5-4ac6-469f-a289-b0c5d77de8f6 None None] MFA Rules not processed for user `37365503c68446fb98fab52166b542df`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:53:04.078559 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-8e688ec5-4ac6-469f-a289-b0c5d77de8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:04.086032 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 614/1228] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:53:04 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:53:04.405512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04281-a778-40ef-b0c3-34226e2a8271 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:04.406014 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04281-a778-40ef-b0c3-34226e2a8271 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:04.406014 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04281-a778-40ef-b0c3-34226e2a8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:04.429700 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-5ce04281-a778-40ef-b0c3-34226e2a8271 None None] MFA Rules not processed for user `f344891bb32f4d86ab3c2536c3a4ae68`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:53:04.430944 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-5ce04281-a778-40ef-b0c3-34226e2a8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:04.438737 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 615/1229] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 22 20:53:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:53:04.453024 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e688ec5-4ac6-469f-a289-b0c5d77de8f6 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:53:04.464346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e688ec5-4ac6-469f-a289-b0c5d77de8f6 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:53:04.468794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560a0e-93b3-4fce-8844-77712dae31f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:53:04.469450 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560a0e-93b3-4fce-8844-77712dae31f0 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:04.469727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560a0e-93b3-4fce-8844-77712dae31f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:04.469988 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560a0e-93b3-4fce-8844-77712dae31f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:04.477428 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03560a0e-93b3-4fce-8844-77712dae31f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:53:04.478876 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03560a0e-93b3-4fce-8844-77712dae31f0 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:53:04.486724 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 615/1230] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:53:04 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:53:14.422875 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:53:14.483297 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=9 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:53:20.384806 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50c45-5766-4cd3-8b58-74fde141ea2d None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:20.385405 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50c45-5766-4cd3-8b58-74fde141ea2d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:20.385405 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50c45-5766-4cd3-8b58-74fde141ea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:20.410375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-79d50c45-5766-4cd3-8b58-74fde141ea2d None None] MFA Rules not processed for user `37365503c68446fb98fab52166b542df`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:53:20.412488 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-79d50c45-5766-4cd3-8b58-74fde141ea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:20.422515 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 616/1231] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:53:20 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:53:30.402291 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:20.071331 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c14c-2a26-4a9f-8350-cc2718051ad6 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:20.071898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c14c-2a26-4a9f-8350-cc2718051ad6 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:20.071898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c14c-2a26-4a9f-8350-cc2718051ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:20.095708 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-d151c14c-2a26-4a9f-8350-cc2718051ad6 None None] MFA Rules not processed for user `37365503c68446fb98fab52166b542df`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:54:20.096899 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-d151c14c-2a26-4a9f-8350-cc2718051ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:20.104567 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 616/1232] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:54:20 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:54:30.090620 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=3 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:33.100456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50c45-5766-4cd3-8b58-74fde141ea2d None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:33.130360 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50c45-5766-4cd3-8b58-74fde141ea2d None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:33.135236 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:33.135873 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:33.136300 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:33.136571 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:33.147083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:33.148630 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:33.159029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 617/1233] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:54:33 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:54:43.154808 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=10 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:55:37.325341 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c14c-2a26-4a9f-8350-cc2718051ad6 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:55:37.349133 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c14c-2a26-4a9f-8350-cc2718051ad6 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:55:37.355076 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:55:37.355687 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:55:37.355953 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:55:37.356224 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:55:37.365085 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:55:37.366747 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:55:37.376917 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 617/1234] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:55:37 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:55:47.372962 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=10 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:40.205123 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:40.229929 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db275cad-f560-4483-a042-0e801109b7ee service neutron] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:40.235820 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc8d19-9271-4acd-888a-a0f0cfc10a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:40.236425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8d19-9271-4acd-888a-a0f0cfc10a84 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:40.236699 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8d19-9271-4acd-888a-a0f0cfc10a84 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:40.236961 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8d19-9271-4acd-888a-a0f0cfc10a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:40.245662 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc8d19-9271-4acd-888a-a0f0cfc10a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:40.247920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc8d19-9271-4acd-888a-a0f0cfc10a84 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:40.256846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 618/1235] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:40 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:43.041344 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:43.050720 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826abb42-21cc-42b4-9f59-a7adb362f589 service placement] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:43.054355 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:43.054944 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:43.055219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:43.055487 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:43.065677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:43.067249 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:43.077939 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 618/1236] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:44.215778 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605427-2b00-4fb9-a98b-5b91868799d8 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:44.216289 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605427-2b00-4fb9-a98b-5b91868799d8 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:44.216375 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605427-2b00-4fb9-a98b-5b91868799d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:44.236390 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-58605427-2b00-4fb9-a98b-5b91868799d8 None None] MFA Rules not processed for user `37365503c68446fb98fab52166b542df`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:56:44.237646 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-58605427-2b00-4fb9-a98b-5b91868799d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:44.245377 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 619/1237] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:56:44 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:56:44.291511 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:44.358637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92e4ff-ad92-4af7-8e18-9bcf308398e3 service neutron] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:44.362573 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e0c0dc1360a4dce928cbc27eab76ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:44.363184 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:44.363462 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:44.363730 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:44.375298 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:44.376749 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:44.387244 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 619/1238] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:45.165078 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58605427-2b00-4fb9-a98b-5b91868799d8 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:45.178156 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58605427-2b00-4fb9-a98b-5b91868799d8 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:45.183669 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f038add-e6c1-4437-9478-210a0a7c0ad4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:45.184280 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f038add-e6c1-4437-9478-210a0a7c0ad4 service placement] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:45.184552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f038add-e6c1-4437-9478-210a0a7c0ad4 service placement] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:45.184813 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f038add-e6c1-4437-9478-210a0a7c0ad4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:45.193857 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f038add-e6c1-4437-9478-210a0a7c0ad4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:45.195418 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f038add-e6c1-4437-9478-210a0a7c0ad4 service placement] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:45.206083 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 620/1239] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:56:48.175401 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:48.186311 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feed8cb-d01f-43c1-a762-454cdadb7cc9 service cinder] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:48.193053 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15766c59-e9d1-4664-9492-330d64a8c719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:48.193613 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15766c59-e9d1-4664-9492-330d64a8c719 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:48.193859 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15766c59-e9d1-4664-9492-330d64a8c719 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:48.194145 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15766c59-e9d1-4664-9492-330d64a8c719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:48.202874 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15766c59-e9d1-4664-9492-330d64a8c719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:48.204465 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15766c59-e9d1-4664-9492-330d64a8c719 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:48.213514 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 620/1240] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:48 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:55.201560 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=19 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:56.176993 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2761a-d65e-44b1-8a98-68e4edb2d8be None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:56.177309 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2761a-d65e-44b1-8a98-68e4edb2d8be None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:56.177582 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2761a-d65e-44b1-8a98-68e4edb2d8be None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:56.178940 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 621/1241] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 20:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:56:56.183644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff39f2-75cd-4058-b571-7a1819376267 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:56.184088 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff39f2-75cd-4058-b571-7a1819376267 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:56.184206 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff39f2-75cd-4058-b571-7a1819376267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:56.241219 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-0cff39f2-75cd-4058-b571-7a1819376267 None None] MFA Rules not processed for user `26fd52c94dc342eea817105f34e48190`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:56:56.242479 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-0cff39f2-75cd-4058-b571-7a1819376267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:56.252195 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 621/1242] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 20:56:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:56:56.264532 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2761a-d65e-44b1-8a98-68e4edb2d8be None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:56.279338 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2761a-d65e-44b1-8a98-68e4edb2d8be None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:56.285374 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1d2d9-db21-4f71-926a-952dce444a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:56.285991 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d2d9-db21-4f71-926a-952dce444a48 service nova] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:56.286310 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d2d9-db21-4f71-926a-952dce444a48 service nova] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:56.286622 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d2d9-db21-4f71-926a-952dce444a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:56.304330 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1d2d9-db21-4f71-926a-952dce444a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:56.306029 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1d2d9-db21-4f71-926a-952dce444a48 service nova] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:56.316361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 622/1243] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:59.456625 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff39f2-75cd-4058-b571-7a1819376267 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:59.468431 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff39f2-75cd-4058-b571-7a1819376267 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:59.472844 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:59.473676 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:59.474126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:59.474545 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:59.482993 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:59.487008 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:59.496446 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 622/1244] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:59 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:57:05.179679 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830e55c-0e6d-44f3-9f17-cd5492854338 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:57:05.180231 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830e55c-0e6d-44f3-9f17-cd5492854338 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:57:05.180231 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830e55c-0e6d-44f3-9f17-cd5492854338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:57:05.200691 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-e830e55c-0e6d-44f3-9f17-cd5492854338 None None] MFA Rules not processed for user `8d4ad9cedd824a3d81f4c07f8b067da1`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:57:05.202020 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e830e55c-0e6d-44f3-9f17-cd5492854338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:57:05.209456 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 623/1245] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:57:05 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:57:09.492363 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=61 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:57:15.195761 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=9 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:57:24.880284 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:57:24.896764 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccf75-a04e-4399-8b6e-ec5634c4f42c service neutron] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:57:24.902876 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:57:24.903606 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:57:24.903885 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:57:24.904153 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:57:24.913756 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:57:24.915444 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:57:24.925632 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 623/1246] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:57:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:57:33.282076 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830e55c-0e6d-44f3-9f17-cd5492854338 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:57:33.292775 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830e55c-0e6d-44f3-9f17-cd5492854338 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:57:33.297493 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a341-ca43-4609-90cf-537592363645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:57:33.298099 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a341-ca43-4609-90cf-537592363645 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:57:33.298371 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a341-ca43-4609-90cf-537592363645 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:57:33.298636 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a341-ca43-4609-90cf-537592363645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:57:33.308399 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a341-ca43-4609-90cf-537592363645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:57:33.309890 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a341-ca43-4609-90cf-537592363645 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:57:33.319362 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 624/1247] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:57:33 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:57:34.922028 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=6 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:57:36.861266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:57:36.878515 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039def7-ae4d-475d-b143-a6990c3a3296 service nova] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:57:36.885058 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fd52c94dc342eea817105f34e48190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:57:36.886461 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:57:36.886896 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:57:36.887318 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:57:36.897542 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:57:36.899535 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:57:36.911741 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 624/1248] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:57:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:57:43.315420 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=6 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:57:46.907152 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=6 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:58:51.317894 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b483b8-0eae-4429-b7e2-db1377f1a4a8 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:51.318484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b483b8-0eae-4429-b7e2-db1377f1a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:51.318484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b483b8-0eae-4429-b7e2-db1377f1a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:51.338414 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-55b483b8-0eae-4429-b7e2-db1377f1a4a8 None None] MFA Rules not processed for user `37365503c68446fb98fab52166b542df`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:58:51.339607 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-55b483b8-0eae-4429-b7e2-db1377f1a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:51.347259 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 625/1249] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 22 20:58:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:58:51.702210 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:58:51.711566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2b63f-6623-4228-90d5-04ef28b01029 service nova] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:58:51.715448 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bcf4e-7d94-4ce7-8a0a-e0af28429a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:58:51.716030 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bcf4e-7d94-4ce7-8a0a-e0af28429a3c service neutron] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:51.716304 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bcf4e-7d94-4ce7-8a0a-e0af28429a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:51.716564 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bcf4e-7d94-4ce7-8a0a-e0af28429a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:51.723800 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bcf4e-7d94-4ce7-8a0a-e0af28429a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:58:51.725266 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bcf4e-7d94-4ce7-8a0a-e0af28429a3c service neutron] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:58:51.732898 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 625/1250] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 20:58:51 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:59:01.333299 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=3 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:59:01.729707 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=6 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:00:00.449945 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b483b8-0eae-4429-b7e2-db1377f1a4a8 None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:00.475211 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b483b8-0eae-4429-b7e2-db1377f1a4a8 None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:00.479682 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282bde1-d771-43f5-a82f-36554d123286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:00.480327 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282bde1-d771-43f5-a82f-36554d123286 service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:00.480710 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282bde1-d771-43f5-a82f-36554d123286 service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:00.480974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282bde1-d771-43f5-a82f-36554d123286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:00.586468 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282bde1-d771-43f5-a82f-36554d123286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:00.588417 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282bde1-d771-43f5-a82f-36554d123286 service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:00.610430 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 626/1251] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 21:00:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 21:00:04.458915 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baab556-d615-4bc1-9045-5e6d28584973 None None] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:04.459498 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baab556-d615-4bc1-9045-5e6d28584973 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:04.459586 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baab556-d615-4bc1-9045-5e6d28584973 None None] PATH_INFO: `/` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:04.461005 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 626/1252] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 21:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 21:00:04.473447 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551273-2a57-492d-89fc-c1fb11402481 None None] REQUEST_METHOD: `POST` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:04.474015 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551273-2a57-492d-89fc-c1fb11402481 None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:04.474015 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551273-2a57-492d-89fc-c1fb11402481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:04.584484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.auth.core [None req-b8551273-2a57-492d-89fc-c1fb11402481 None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 21:00:04.585356 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-b8551273-2a57-492d-89fc-c1fb11402481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:00:04.608490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 627/1253] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 21:00:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 21:00:04.620644 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baab556-d615-4bc1-9045-5e6d28584973 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:04.636512 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baab556-d615-4bc1-9045-5e6d28584973 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:04.643631 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c634ff-cbd1-409d-b0ed-816b26e1f9cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:04.644458 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c634ff-cbd1-409d-b0ed-816b26e1f9cd service placement] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:04.644794 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c634ff-cbd1-409d-b0ed-816b26e1f9cd service placement] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:04.645311 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c634ff-cbd1-409d-b0ed-816b26e1f9cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:04.658306 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c634ff-cbd1-409d-b0ed-816b26e1f9cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:04.660128 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c634ff-cbd1-409d-b0ed-816b26e1f9cd service placement] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:04.672810 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 627/1254] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 21:00:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 21:00:07.872328 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49889151-a018-4aba-aa5b-fb1cdc1c605d None None] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:07.872887 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49889151-a018-4aba-aa5b-fb1cdc1c605d None None] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:07.872996 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49889151-a018-4aba-aa5b-fb1cdc1c605d None None] PATH_INFO: `/` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:07.874313 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 628/1255] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 22 21:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 21:00:07.886294 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f2322-8b2a-4a44-8e37-1a356f058ba9 None None] REQUEST_METHOD: `POST` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:07.886986 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f2322-8b2a-4a44-8e37-1a356f058ba9 None None] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:07.886986 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f2322-8b2a-4a44-8e37-1a356f058ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:07.907677 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.auth.core [None req-aa8f2322-8b2a-4a44-8e37-1a356f058ba9 None None] MFA Rules not processed for user `48a5ba0a3da749309b1c514b13a3141b`. Rule list: `[]` (Enabled: `True`). {{(pid=100161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 21:00:07.908882 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-aa8f2322-8b2a-4a44-8e37-1a356f058ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:00:07.917796 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 628/1256] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 22 21:00:07 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 21:00:07.936512 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49889151-a018-4aba-aa5b-fb1cdc1c605d None None] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:07.951443 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49889151-a018-4aba-aa5b-fb1cdc1c605d None None] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:07.953622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f2322-8b2a-4a44-8e37-1a356f058ba9 None None] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:07.956471 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:07.957257 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:07.957537 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:07.957807 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:07.966126 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f2322-8b2a-4a44-8e37-1a356f058ba9 None None] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:07.967189 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:07.968812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:07.971757 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:07.972387 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:07.972657 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:07.972920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] PATH_INFO: `/v3/users/8d4ad9cedd824a3d81f4c07f8b067da1` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:07.974414 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4ad9cedd824a3d81f4c07f8b067da1)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:07.975423 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: WARNING py.warnings [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 21:00:07.975423 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: warnings.warn(msg) Aug 22 21:00:07.975423 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: Aug 22 21:00:07.976719 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:07.978700 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 629/1257] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 21:00:07 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 21:00:08.060460 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4ad9cedd824a3d81f4c07f8b067da1'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.072385 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4ad9cedd824a3d81f4c07f8b067da1'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.073166 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4ad9cedd824a3d81f4c07f8b067da1'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.073930 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4ad9cedd824a3d81f4c07f8b067da1'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.095280 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4ad9cedd824a3d81f4c07f8b067da1'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.110637 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 629/1258] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 22 21:00:07 2022] DELETE /identity/v3/users/8d4ad9cedd824a3d81f4c07f8b067da1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 21:00:08.299862 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:08.311605 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fad9d-839b-488a-83fd-5f1e80745ab4 service placement] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:08.346429 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=100 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:00:08.373552 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:08.374176 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:08.374445 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:08.374708 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] PATH_INFO: `/v3/projects/a523a47573f142c989948d6f970cd0ae` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:08.375835 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a523a47573f142c989948d6f970cd0ae)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:08.376846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: WARNING py.warnings [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 21:00:08.376846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: warnings.warn(msg) Aug 22 21:00:08.376846 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: Aug 22 21:00:08.378073 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:08.440553 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a523a47573f142c989948d6f970cd0ae', 'request_id': 'req-0969eaeb-e54c-4037-abb2-8d564952c5f9'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.454867 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a523a47573f142c989948d6f970cd0ae', 'request_id': 'req-0969eaeb-e54c-4037-abb2-8d564952c5f9'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.465840 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a523a47573f142c989948d6f970cd0ae', 'request_id': 'req-0969eaeb-e54c-4037-abb2-8d564952c5f9'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.495757 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] The token cache is being invalidate because project a523a47573f142c989948d6f970cd0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 21:00:08.496151 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.496900 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.498572 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 630/1259] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 22 21:00:08 2022] DELETE /identity/v3/projects/a523a47573f142c989948d6f970cd0ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 21:00:08.502857 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:08.504451 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:00:08.518657 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bbadf-4acf-40f6-80b3-b446d34c7b20 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:08.579774 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:08.580323 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:08.580582 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:08.580846 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] PATH_INFO: `/v3/users/ac161ebddcc648528b663967a439724a` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:08.582064 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac161ebddcc648528b663967a439724a)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:08.584357 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:08.644727 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac161ebddcc648528b663967a439724a'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.650353 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:00:08.652591 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac161ebddcc648528b663967a439724a'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.653622 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac161ebddcc648528b663967a439724a'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.654572 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac161ebddcc648528b663967a439724a'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.667728 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac161ebddcc648528b663967a439724a'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:08.682587 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 630/1260] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 22 21:00:08 2022] DELETE /identity/v3/users/ac161ebddcc648528b663967a439724a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 21:00:08.884950 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:08.886648 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:00:08.899588 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969eaeb-e54c-4037-abb2-8d564952c5f9 admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:08.960296 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:08.960920 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:08.961232 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:08.961527 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] PATH_INFO: `/v3/projects/2356c76f01424ec292facfbbd8fee066` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:08.962674 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2356c76f01424ec292facfbbd8fee066)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:08.964800 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:09.013412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2356c76f01424ec292facfbbd8fee066', 'request_id': 'req-e4f6a05d-bfbe-4891-bf56-7505c579d92c'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:09.019799 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2356c76f01424ec292facfbbd8fee066', 'request_id': 'req-e4f6a05d-bfbe-4891-bf56-7505c579d92c'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:09.022287 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:00:09.031186 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2356c76f01424ec292facfbbd8fee066', 'request_id': 'req-e4f6a05d-bfbe-4891-bf56-7505c579d92c'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:09.042425 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] The token cache is being invalidate because project 2356c76f01424ec292facfbbd8fee066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 21:00:09.042714 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:09.043454 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:00:09.044974 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 631/1261] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 22 21:00:08 2022] DELETE /identity/v3/projects/2356c76f01424ec292facfbbd8fee066 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 21:00:18.679230 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:00:19.039487 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:DELETE=3,keystone:SELECT=4 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:00:43.199141 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:00:43.200852 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:00:43.278776 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34458a-cca6-4a05-ad06-6b51b975c467 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:00:43.340558 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:00:43.341197 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:00:43.341470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:00:43.341737 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:00:43.343691 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:00:43.354934 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:00:43.356516 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:00:43.366172 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 631/1262] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 21:00:43 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 21:00:53.362376 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=58 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:01:40.738558 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:01:40.740212 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:01:40.819335 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6a05d-bfbe-4891-bf56-7505c579d92c admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:01:40.823442 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f344891bb32f4d86ab3c2536c3a4ae68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:01:40.824047 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] REQUEST_METHOD: `GET` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:01:40.824314 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:01:40.824602 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:01:40.826587 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:01:40.894361 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:01:40.896484 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:01:40.906903 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 632/1263] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 21:01:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 21:01:47.099877 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:01:47.101346 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:01:47.116648 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23ecd3-8cd4-43e6-850d-7fd8d620b285 service placement] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:01:47.121617 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:01:47.122180 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] REQUEST_METHOD: `DELETE` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:01:47.122470 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:01:47.122704 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] PATH_INFO: `/v3/users/37365503c68446fb98fab52166b542df` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:01:47.137419 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] RBAC: Authorizing `identity:delete_user(user_id=37365503c68446fb98fab52166b542df)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:01:47.139391 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:01:47.193487 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37365503c68446fb98fab52166b542df'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.203905 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37365503c68446fb98fab52166b542df'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.204949 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37365503c68446fb98fab52166b542df'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.205704 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37365503c68446fb98fab52166b542df'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.223807 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37365503c68446fb98fab52166b542df'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.240212 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 632/1264] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 22 21:01:47 2022] DELETE /identity/v3/users/37365503c68446fb98fab52166b542df => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 21:01:47.425745 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:01:47.436733 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65c445-362c-4dc9-bc69-299618f0d4fc service neutron] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:01:47.497157 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:01:47.497712 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:01:47.497984 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:01:47.498251 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] PATH_INFO: `/v3/projects/5830abb52b114b1980bc46b03ae3976d` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:01:47.508906 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5830abb52b114b1980bc46b03ae3976d)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:01:47.510881 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:01:47.546936 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:01:47.559561 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5830abb52b114b1980bc46b03ae3976d', 'request_id': 'req-7db55a51-973b-4d9d-af7e-c12232effaea'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.567472 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5830abb52b114b1980bc46b03ae3976d', 'request_id': 'req-7db55a51-973b-4d9d-af7e-c12232effaea'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.576259 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5830abb52b114b1980bc46b03ae3976d', 'request_id': 'req-7db55a51-973b-4d9d-af7e-c12232effaea'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.586652 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] The token cache is being invalidate because project 5830abb52b114b1980bc46b03ae3976d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 21:01:47.586937 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.587584 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.589016 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 633/1265] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 22 21:01:47 2022] DELETE /identity/v3/projects/5830abb52b114b1980bc46b03ae3976d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 21:01:47.593281 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:01:47.594870 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:01:47.608536 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206dba-12ff-4e6c-af57-9a85831923be admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:01:47.667364 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:01:47.667994 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:01:47.668268 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:01:47.668533 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] PATH_INFO: `/v3/users/29a8faf9906b4268af108f5d786946a3` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:01:47.683223 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a8faf9906b4268af108f5d786946a3)` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:01:47.685205 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:01:47.733819 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a8faf9906b4268af108f5d786946a3'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.738273 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:01:47.741528 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a8faf9906b4268af108f5d786946a3'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.742444 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a8faf9906b4268af108f5d786946a3'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.743190 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a8faf9906b4268af108f5d786946a3'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.756045 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.notifications [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a8faf9906b4268af108f5d786946a3'} {{(pid=100161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:47.769981 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 633/1266] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 22 21:01:47 2022] DELETE /identity/v3/users/29a8faf9906b4268af108f5d786946a3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 21:01:47.957834 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Authenticating user token {{(pid=100160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:01:47.959412 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.fernet_utils [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:01:47.972812 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db55a51-973b-4d9d-af7e-c12232effaea admin admin] Validating token access rules against request {{(pid=100160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:01:48.034834 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce5922f39ab43c1aa73a41f5fc3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc9a30a2c0d456c80b6d663506d1794', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:01:48.035478 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:01:48.035758 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:01:48.036027 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] PATH_INFO: `/v3/projects/700e3519d5b2440394ad5c0e7e0a4148` {{(pid=100160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:01:48.046728 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700e3519d5b2440394ad5c0e7e0a4148)` {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:01:48.048681 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] RBAC: Authorization granted {{(pid=100160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:01:48.101683 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700e3519d5b2440394ad5c0e7e0a4148', 'request_id': 'req-87b866ff-3902-40be-a67c-10ee5d8af4c6'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:48.108639 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700e3519d5b2440394ad5c0e7e0a4148', 'request_id': 'req-87b866ff-3902-40be-a67c-10ee5d8af4c6'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:48.119220 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700e3519d5b2440394ad5c0e7e0a4148', 'request_id': 'req-87b866ff-3902-40be-a67c-10ee5d8af4c6'} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:48.130625 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] The token cache is being invalidate because project 700e3519d5b2440394ad5c0e7e0a4148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 21:01:48.130901 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:48.131490 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG keystone.notifications [None req-87b866ff-3902-40be-a67c-10ee5d8af4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 21:01:48.133008 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: [pid: 100160|app: 0|req: 634/1267] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 22 21:01:47 2022] DELETE /identity/v3/projects/700e3519d5b2440394ad5c0e7e0a4148 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 21:01:57.766652 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=10,keystone:DELETE=3,keystone:INSERT=1 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:01:58.127503 dv-osbrick-853789-1-ceph devstack@keystone.service[100160]: DEBUG dbcounter [-] [100160] Writing DB stats keystone:SELECT=67,keystone:DELETE=12,keystone:INSERT=2 {{(pid=100160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:05:48.260566 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Authenticating user token {{(pid=100161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:05:48.262190 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:05:48.356243 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb138b00-d311-4cd4-9a85-24157524e9f2 admin admin] Validating token access rules against request {{(pid=100161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:05:48.432749 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f81f2e-bc7c-4e01-b83f-f10a2a45cf1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a5ba0a3da749309b1c514b13a3141b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23a3011ea504944be8e0d8f3394d7df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:05:48.433393 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81f2e-bc7c-4e01-b83f-f10a2a45cf1a service placement] REQUEST_METHOD: `GET` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:05:48.433675 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81f2e-bc7c-4e01-b83f-f10a2a45cf1a service placement] SCRIPT_NAME: `/identity` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:05:48.433945 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81f2e-bc7c-4e01-b83f-f10a2a45cf1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:05:48.435920 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.fernet_utils [None req-09f81f2e-bc7c-4e01-b83f-f10a2a45cf1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:05:48.447559 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f81f2e-bc7c-4e01-b83f-f10a2a45cf1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:05:48.449203 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f81f2e-bc7c-4e01-b83f-f10a2a45cf1a service placement] RBAC: Authorization granted {{(pid=100161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:05:48.459329 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: [pid: 100161|app: 0|req: 634/1268] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 22 21:05:48 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 21:05:58.455165 dv-osbrick-853789-1-ceph devstack@keystone.service[100161]: DEBUG dbcounter [-] [100161] Writing DB stats keystone:SELECT=62 {{(pid=100161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}